2024-08-19T05:36:59,979 Created temporary directory: /tmp/pip-build-tracker-3q1bnmao
2024-08-19T05:36:59,980 Initialized build tracking at /tmp/pip-build-tracker-3q1bnmao
2024-08-19T05:36:59,981 Created build tracker: /tmp/pip-build-tracker-3q1bnmao
2024-08-19T05:36:59,981 Entered build tracker: /tmp/pip-build-tracker-3q1bnmao
2024-08-19T05:36:59,982 Created temporary directory: /tmp/pip-wheel-i23jy73i
2024-08-19T05:36:59,986 Created temporary directory: /tmp/pip-ephem-wheel-cache-5rli304y
2024-08-19T05:37:00,029 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
2024-08-19T05:37:00,031 2 location(s) to search for versions of deepspeed:
2024-08-19T05:37:00,031 * https://pypi.org/simple/deepspeed/
2024-08-19T05:37:00,031 * https://www.piwheels.org/simple/deepspeed/
2024-08-19T05:37:00,032 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/
2024-08-19T05:37:00,033 Getting page https://pypi.org/simple/deepspeed/
2024-08-19T05:37:00,034 Found index url https://pypi.org/simple/
2024-08-19T05:37:00,171 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json
2024-08-19T05:37:00,188   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-19T05:37:00,189   Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1
2024-08-19T05:37:00,189   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-19T05:37:00,190   Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2
2024-08-19T05:37:00,190   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-19T05:37:00,191   Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3
2024-08-19T05:37:00,192   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-19T05:37:00,192   Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4
2024-08-19T05:37:00,193   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/)
2024-08-19T05:37:00,194   Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5
2024-08-19T05:37:00,194   Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6
2024-08-19T05:37:00,195   Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7
2024-08-19T05:37:00,196   Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8
2024-08-19T05:37:00,196   Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1
2024-08-19T05:37:00,197   Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2
2024-08-19T05:37:00,198   Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3
2024-08-19T05:37:00,198   Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4
2024-08-19T05:37:00,199   Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5
2024-08-19T05:37:00,199   Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6
2024-08-19T05:37:00,200   Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7
2024-08-19T05:37:00,201   Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8
2024-08-19T05:37:00,201   Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9
2024-08-19T05:37:00,202   Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10
2024-08-19T05:37:00,202   Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11
2024-08-19T05:37:00,203   Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12
2024-08-19T05:37:00,203   Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13
2024-08-19T05:37:00,204   Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14
2024-08-19T05:37:00,205   Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15
2024-08-19T05:37:00,205   Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16
2024-08-19T05:37:00,206   Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0
2024-08-19T05:37:00,207   Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1
2024-08-19T05:37:00,207   Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2
2024-08-19T05:37:00,208   Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3
2024-08-19T05:37:00,209   Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4
2024-08-19T05:37:00,209   Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5
2024-08-19T05:37:00,210   Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0
2024-08-19T05:37:00,210   Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1
2024-08-19T05:37:00,211   Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2
2024-08-19T05:37:00,211   Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3
2024-08-19T05:37:00,212   Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4
2024-08-19T05:37:00,213   Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5
2024-08-19T05:37:00,213   Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6
2024-08-19T05:37:00,214   Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7
2024-08-19T05:37:00,214   Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8
2024-08-19T05:37:00,215   Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9
2024-08-19T05:37:00,216   Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10
2024-08-19T05:37:00,216   Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0
2024-08-19T05:37:00,217   Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1
2024-08-19T05:37:00,217   Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3
2024-08-19T05:37:00,218   Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4
2024-08-19T05:37:00,219   Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5
2024-08-19T05:37:00,219   Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6
2024-08-19T05:37:00,220   Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7
2024-08-19T05:37:00,221   Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0
2024-08-19T05:37:00,221   Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1
2024-08-19T05:37:00,222   Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2
2024-08-19T05:37:00,223   Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3
2024-08-19T05:37:00,223   Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4
2024-08-19T05:37:00,224   Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5
2024-08-19T05:37:00,224   Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6
2024-08-19T05:37:00,225   Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7
2024-08-19T05:37:00,226   Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0
2024-08-19T05:37:00,226   Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1
2024-08-19T05:37:00,227   Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2
2024-08-19T05:37:00,228   Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3
2024-08-19T05:37:00,228   Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0
2024-08-19T05:37:00,229   Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1
2024-08-19T05:37:00,230   Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2
2024-08-19T05:37:00,230   Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3
2024-08-19T05:37:00,231   Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4
2024-08-19T05:37:00,231   Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5
2024-08-19T05:37:00,232   Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0
2024-08-19T05:37:00,232   Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1
2024-08-19T05:37:00,233   Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2
2024-08-19T05:37:00,234   Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3
2024-08-19T05:37:00,234   Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0
2024-08-19T05:37:00,235   Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1
2024-08-19T05:37:00,235   Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2
2024-08-19T05:37:00,236   Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0
2024-08-19T05:37:00,237   Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1
2024-08-19T05:37:00,237   Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2
2024-08-19T05:37:00,238   Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3
2024-08-19T05:37:00,238   Found link https://files.pythonhosted.org/packages/b8/a2/201f57d766b23af6b66769d7dc633816ca766f79ba37e0e4a325eca763b0/deepspeed-0.12.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.4
2024-08-19T05:37:00,239   Found link https://files.pythonhosted.org/packages/3b/c7/c962c7515511ee4f6fe092506e303ef6973c58cfa18ff7edcebb455261b5/deepspeed-0.12.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.5
2024-08-19T05:37:00,240   Found link https://files.pythonhosted.org/packages/f1/ff/0fba0fec90e7de1c7148b0527e8ac9cdf2280d274ed135bcb2187f7497a7/deepspeed-0.12.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.6
2024-08-19T05:37:00,240   Found link https://files.pythonhosted.org/packages/fb/39/e5540ed55adf53ede9e271a82c90a6b53dae3c6bb6f973ba9e3366b9f9c7/deepspeed-0.13.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.0
2024-08-19T05:37:00,241   Found link https://files.pythonhosted.org/packages/ce/f8/3b63074f1841dd6cf5414decf9c4a338a34915d8491bb719608ec56cc3bb/deepspeed-0.13.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.1
2024-08-19T05:37:00,241   Found link https://files.pythonhosted.org/packages/5d/4b/382b6c7f22a9f51875e5a159a2a8e94c2b3b01b0c86f7bed2ea7cf919549/deepspeed-0.13.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.2
2024-08-19T05:37:00,242   Found link https://files.pythonhosted.org/packages/cf/5a/74ac54cc4de191fdc0ccd6e788fe38c8ec39af863aa283f4bd748924e94c/deepspeed-0.13.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.3
2024-08-19T05:37:00,242   Found link https://files.pythonhosted.org/packages/0c/16/2730831cbbb3f59e2e39dd2dd7a9ed973fb4119b2c61a0a9ebd722935dd3/deepspeed-0.13.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.4
2024-08-19T05:37:00,243   Found link https://files.pythonhosted.org/packages/ac/05/0c396c283577ed5c21890b24fdbaff81637fe4abc8c4667ed8adda06bb43/deepspeed-0.13.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.13.5
2024-08-19T05:37:00,244   Found link https://files.pythonhosted.org/packages/c4/d2/8ef74ea43580db602b845a499340ee21da98fb1e749d86ab9ee16bc32bd2/deepspeed-0.14.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.0
2024-08-19T05:37:00,244   Found link https://files.pythonhosted.org/packages/0b/f4/a258e44de109c2e6228c78468ab95c47aa1e7110995e0ccebeddbf912e7b/deepspeed-0.14.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.1
2024-08-19T05:37:00,245   Found link https://files.pythonhosted.org/packages/f0/84/a7b8ff287f7e1a5f01a010880b0bc5e58f718eaca784b4be592034eab3de/deepspeed-0.14.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.2
2024-08-19T05:37:00,245   Found link https://files.pythonhosted.org/packages/d3/ed/bf1db676023a564f99a11b3d8a22d9f5dff222f5edd62fa49f71c5ba6df0/deepspeed-0.14.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.3
2024-08-19T05:37:00,246   Found link https://files.pythonhosted.org/packages/2e/06/7315113506f1804b8ba4f77cb31905c62f7080452a0af2d13eaadaa83a08/deepspeed-0.14.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.4
2024-08-19T05:37:00,246   Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/bb/cf/e334484790a5701b04d1c859fd518a03e4fca36c78eb50185796ddfc5da8/deepspeed-0.14.5-cp311-cp311-win_amd64.whl (from https://pypi.org/simple/deepspeed/)
2024-08-19T05:37:00,247   Found link https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.14.5
2024-08-19T05:37:00,248 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/
2024-08-19T05:37:00,248 Getting page https://www.piwheels.org/simple/deepspeed/
2024-08-19T05:37:00,249 Found index url https://www.piwheels.org/simple/
2024-08-19T05:37:00,419 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html
2024-08-19T05:37:00,436   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.4-py3-none-any.whl#sha256=95034dad0450d8435cf207a6dffa0fb9845b42910f0d47a9bfbafbea6a4bf855 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,437   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.3-py3-none-any.whl#sha256=75c953b575ee35f266e7d35350f215e8ea96e18bc9e2a91ec6467b274de88d88 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,437   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.2-py3-none-any.whl#sha256=225830c001e73e687be2a54eef385ddf6cf21fe8073e150867df58f1a14b6e46 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,438   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.1-py3-none-any.whl#sha256=4ce2957bd760467fb1e5e5b4086ee13c04a45e4a7ba6b806527ec16d0e06958b (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,438   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.14.0-py3-none-any.whl#sha256=d7aa7c624d2d02b4b41098d23cf9b40df9ec20ff13ad8f80c01165408a74035c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,439   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.5-py3-none-any.whl#sha256=cf41f214564204f298d4814cb79ee349c6656f4389773ad72b087d9b04b5a66b (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,439   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.4-py3-none-any.whl#sha256=1b2ef911839d3b52541b16c6f7d80b8d1e437e247d053681def4574203cb8ab7 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,440   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.3-py3-none-any.whl#sha256=6a1f81e7b19ba92ed6f23df6ca196b6ba62b6d4fbdc96684917807da90c5e189 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,440   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.2-py3-none-any.whl#sha256=56d107fb7f445f58af0e0ffbaf4d9773172cb58a468a4052d7a073a146862fbd (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,441   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.13.1-py3-none-any.whl#sha256=f8e5c05479a2f31455eed7968f30ae4a7ac9c53fcb8e50b478c6b10d87f67cf1 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,441   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.6-py3-none-any.whl#sha256=1c0e0bb7da0dc774cc8d9e7ca1d383b201bd3ee962d6893a918993d45ab108dd (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,442   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.5-py3-none-any.whl#sha256=bb2b6f6cc1b1005740ca7f5e4dd41b56f6b8c26fbef80bf740ca702ee02b2a05 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,442   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.4-py3-none-any.whl#sha256=3d05d4265d3c467668281c3006ddcbd7e7c37f0cff41b03ecfeeeebea59ae8fd (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,443   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.3-py3-none-any.whl#sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,443   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,444   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,444   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,445   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,446   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,446   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,447   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,447   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,448   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,448   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,449   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,449   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,450   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,450   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,451   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,452   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,452   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,453   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,453   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,454   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,455   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,455   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,456   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,456   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,457   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,457   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,458   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,458   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,459   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,459   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,460   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,460   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,461   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,462   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,462   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,463   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,463   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,463   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,464   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,465   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,465   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,466   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,466   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,466   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,467   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,468   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,468   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,469   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,469   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,470   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,470   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,471   Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/)
2024-08-19T05:37:00,472 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/
2024-08-19T05:37:00,472 Skipping link: not a file: https://pypi.org/simple/deepspeed/
2024-08-19T05:37:00,503 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates
2024-08-19T05:37:00,506 Collecting deepspeed==0.14.5
2024-08-19T05:37:00,508   Created temporary directory: /tmp/pip-unpack-al6cb6p7
2024-08-19T05:37:00,644   Downloading deepspeed-0.14.5.tar.gz (1.4 MB)
2024-08-19T05:37:03,026   Added deepspeed==0.14.5 from https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz to build tracker '/tmp/pip-build-tracker-3q1bnmao'
2024-08-19T05:37:03,028   Running setup.py (path:/tmp/pip-wheel-i23jy73i/deepspeed_fe0e7f84626a4200b568e564b705dd50/setup.py) egg_info for package deepspeed
2024-08-19T05:37:03,029   Created temporary directory: /tmp/pip-pip-egg-info-5j69dtue
2024-08-19T05:37:03,029   Preparing metadata (setup.py): started
2024-08-19T05:37:03,031   Running command python setup.py egg_info
2024-08-19T05:37:04,073   fatal: not a git repository (or any of the parent directories): .git
2024-08-19T05:37:04,773   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-08-19T05:37:04,773    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-08-19T05:37:04,774   DS_BUILD_OPS=0
2024-08-19T05:37:04,774    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-08-19T05:37:04,775    [WARNING]  async_io: please install the libaio-dev package with apt
2024-08-19T05:37:04,775    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-08-19T05:37:04,776    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:04,776    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:04,777    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:04,778    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:04,778    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:04,779    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:04,779   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-08-19T05:37:04,780   version=0.14.5, git_hash=unknown, git_branch=unknown
2024-08-19T05:37:04,780   install_requires=['hjson', 'ninja', 'numpy', 'nvidia-ml-py', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm']
2024-08-19T05:37:04,781   ext_modules=[]
2024-08-19T05:37:04,781   running egg_info
2024-08-19T05:37:04,782   creating /tmp/pip-pip-egg-info-5j69dtue/deepspeed.egg-info
2024-08-19T05:37:04,809   writing /tmp/pip-pip-egg-info-5j69dtue/deepspeed.egg-info/PKG-INFO
2024-08-19T05:37:04,842   writing dependency_links to /tmp/pip-pip-egg-info-5j69dtue/deepspeed.egg-info/dependency_links.txt
2024-08-19T05:37:04,844   writing entry points to /tmp/pip-pip-egg-info-5j69dtue/deepspeed.egg-info/entry_points.txt
2024-08-19T05:37:04,861   writing requirements to /tmp/pip-pip-egg-info-5j69dtue/deepspeed.egg-info/requires.txt
2024-08-19T05:37:04,862   writing top-level names to /tmp/pip-pip-egg-info-5j69dtue/deepspeed.egg-info/top_level.txt
2024-08-19T05:37:04,863   writing manifest file '/tmp/pip-pip-egg-info-5j69dtue/deepspeed.egg-info/SOURCES.txt'
2024-08-19T05:37:05,104   reading manifest file '/tmp/pip-pip-egg-info-5j69dtue/deepspeed.egg-info/SOURCES.txt'
2024-08-19T05:37:05,106   reading manifest template 'MANIFEST.in'
2024-08-19T05:37:05,108   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-08-19T05:37:05,108   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-08-19T05:37:08,905   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-08-19T05:37:10,115   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-08-19T05:37:10,727   warning: no files found matching '*.tr' under directory 'csrc'
2024-08-19T05:37:10,849   warning: no files found matching '*.cc' under directory 'csrc'
2024-08-19T05:37:10,889   warning: no files found matching '*.py' under directory 'benchmarks'
2024-08-19T05:37:10,895   adding license file 'LICENSE'
2024-08-19T05:37:10,932   writing manifest file '/tmp/pip-pip-egg-info-5j69dtue/deepspeed.egg-info/SOURCES.txt'
2024-08-19T05:37:10,935   deepspeed build time = 6.857622385025024 secs
2024-08-19T05:37:11,054   Preparing metadata (setup.py): finished with status 'done'
2024-08-19T05:37:11,060   Source in /tmp/pip-wheel-i23jy73i/deepspeed_fe0e7f84626a4200b568e564b705dd50 has version 0.14.5, which satisfies requirement deepspeed==0.14.5 from https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz
2024-08-19T05:37:11,061   Removed deepspeed==0.14.5 from https://files.pythonhosted.org/packages/85/b1/4f2e80eb76058122ba4a405feff1bf07af084ab5cf282aeecd19b0a3c46a/deepspeed-0.14.5.tar.gz from build tracker '/tmp/pip-build-tracker-3q1bnmao'
2024-08-19T05:37:11,132 Created temporary directory: /tmp/pip-unpack-unh1ezu4
2024-08-19T05:37:11,133 Created temporary directory: /tmp/pip-unpack-l1625wy0
2024-08-19T05:37:11,134 Building wheels for collected packages: deepspeed
2024-08-19T05:37:11,138   Created temporary directory: /tmp/pip-wheel-zutcplas
2024-08-19T05:37:11,139   Building wheel for deepspeed (setup.py): started
2024-08-19T05:37:11,140   Destination directory: /tmp/pip-wheel-zutcplas
2024-08-19T05:37:11,140   Running command python setup.py bdist_wheel
2024-08-19T05:37:11,678   [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system.
2024-08-19T05:37:11,685    [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops.
2024-08-19T05:37:11,763   DS_BUILD_OPS=0
2024-08-19T05:37:11,876    [WARNING]  async_io requires the dev libaio .so object and headers but these were not found.
2024-08-19T05:37:11,935    [WARNING]  async_io: please install the libaio-dev package with apt
2024-08-19T05:37:11,936    [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found.
2024-08-19T05:37:11,937    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:11,938    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:11,938    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:11,939    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:11,940    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:11,941    [WARNING]  Please install torch if trying to pre-compile inference kernels
2024-08-19T05:37:11,941   Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fp_quantizer': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'transformer_inference': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False}
2024-08-19T05:37:11,950   fatal: not a git repository (or any of the parent directories): .git
2024-08-19T05:37:11,952   version=0.14.5, git_hash=unknown, git_branch=unknown
2024-08-19T05:37:11,953   install_requires=['hjson', 'ninja', 'numpy', 'nvidia-ml-py', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'torch', 'tqdm']
2024-08-19T05:37:11,954   ext_modules=[]
2024-08-19T05:37:12,564   running bdist_wheel
2024-08-19T05:37:12,695   running build
2024-08-19T05:37:12,695   running build_py
2024-08-19T05:37:12,725   creating build
2024-08-19T05:37:12,725   creating build/lib
2024-08-19T05:37:12,726   creating build/lib/deepspeed
2024-08-19T05:37:12,727   copying deepspeed/constants.py -> build/lib/deepspeed
2024-08-19T05:37:12,730   copying deepspeed/pydantic_v1.py -> build/lib/deepspeed
2024-08-19T05:37:12,731   copying deepspeed/__init__.py -> build/lib/deepspeed
2024-08-19T05:37:12,734   copying deepspeed/env_report.py -> build/lib/deepspeed
2024-08-19T05:37:12,736   copying deepspeed/git_version_info.py -> build/lib/deepspeed
2024-08-19T05:37:12,738   copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed
2024-08-19T05:37:12,740   creating build/lib/deepspeed/autotuning
2024-08-19T05:37:12,741   copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning
2024-08-19T05:37:12,744   copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning
2024-08-19T05:37:12,746   copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning
2024-08-19T05:37:12,749   copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning
2024-08-19T05:37:12,750   copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning
2024-08-19T05:37:12,753   copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning
2024-08-19T05:37:12,756   creating build/lib/deepspeed/moe
2024-08-19T05:37:12,757   copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe
2024-08-19T05:37:12,759   copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe
2024-08-19T05:37:12,761   copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe
2024-08-19T05:37:12,762   copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe
2024-08-19T05:37:12,765   copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe
2024-08-19T05:37:12,767   copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe
2024-08-19T05:37:12,770   creating build/lib/deepspeed/model_implementations
2024-08-19T05:37:12,771   copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations
2024-08-19T05:37:12,774   creating build/lib/deepspeed/utils
2024-08-19T05:37:12,775   copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,778   copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,780   copying deepspeed/utils/torch.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,782   copying deepspeed/utils/types.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,783   copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,785   copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,787   copying deepspeed/utils/z3_leaf_module.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,789   copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,791   copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,793   copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,795   copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,798   copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,800   copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,802   copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,803   copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,805   copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,807   copying deepspeed/utils/bwc.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,809   copying deepspeed/utils/config.py -> build/lib/deepspeed/utils
2024-08-19T05:37:12,812   creating build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,813   copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,815   copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,818   copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,820   copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,822   copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,825   copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,827   copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,829   copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,830   copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,833   copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint
2024-08-19T05:37:12,836   creating build/lib/deepspeed/runtime
2024-08-19T05:37:12,837   copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,840   copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,843   copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,845   copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,847   copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,849   copying deepspeed/runtime/compiler.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,851   copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,854   copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,855   copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,858   copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,860   copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,862   copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,868   copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,870   copying deepspeed/runtime/base_optimizer.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,872   copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,874   copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,877   copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,879   copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime
2024-08-19T05:37:12,882   creating build/lib/deepspeed/comm
2024-08-19T05:37:12,883   copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm
2024-08-19T05:37:12,885   copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm
2024-08-19T05:37:12,888   copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm
2024-08-19T05:37:12,889   copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm
2024-08-19T05:37:12,892   copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm
2024-08-19T05:37:12,894   copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm
2024-08-19T05:37:12,896   copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm
2024-08-19T05:37:12,898   copying deepspeed/comm/config.py -> build/lib/deepspeed/comm
2024-08-19T05:37:12,899   copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm
2024-08-19T05:37:12,902   creating build/lib/deepspeed/module_inject
2024-08-19T05:37:12,903   copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,905   copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,907   copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,909   copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,910   copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,913   copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,915   copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,917   copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,919   copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,921   copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,923   copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,926   copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,928   copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject
2024-08-19T05:37:12,931   creating build/lib/deepspeed/compression
2024-08-19T05:37:12,932   copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression
2024-08-19T05:37:12,934   copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression
2024-08-19T05:37:12,937   copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression
2024-08-19T05:37:12,939   copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression
2024-08-19T05:37:12,941   copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression
2024-08-19T05:37:12,943   copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression
2024-08-19T05:37:12,945   copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression
2024-08-19T05:37:12,948   copying deepspeed/compression/config.py -> build/lib/deepspeed/compression
2024-08-19T05:37:12,951   creating build/lib/deepspeed/monitor
2024-08-19T05:37:12,952   copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor
2024-08-19T05:37:12,954   copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor
2024-08-19T05:37:12,956   copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor
2024-08-19T05:37:12,958   copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor
2024-08-19T05:37:12,959   copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor
2024-08-19T05:37:12,961   copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor
2024-08-19T05:37:12,963   copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor
2024-08-19T05:37:12,965   copying deepspeed/monitor/comet.py -> build/lib/deepspeed/monitor
2024-08-19T05:37:12,967   creating build/lib/deepspeed/sequence
2024-08-19T05:37:12,968   copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence
2024-08-19T05:37:12,970   copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence
2024-08-19T05:37:12,972   creating build/lib/deepspeed/accelerator
2024-08-19T05:37:12,973   copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-19T05:37:12,975   copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-19T05:37:12,978   copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-19T05:37:12,980   copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-19T05:37:12,982   copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator
2024-08-19T05:37:12,984   copying deepspeed/accelerator/xpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-19T05:37:12,986   copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-19T05:37:12,988   copying deepspeed/accelerator/hpu_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-19T05:37:12,990   copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator
2024-08-19T05:37:12,993   creating build/lib/deepspeed/profiling
2024-08-19T05:37:12,994   copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling
2024-08-19T05:37:12,996   copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling
2024-08-19T05:37:12,997   copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling
2024-08-19T05:37:12,999   creating build/lib/deepspeed/pipe
2024-08-19T05:37:13,000   copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe
2024-08-19T05:37:13,002   creating build/lib/deepspeed/elasticity
2024-08-19T05:37:13,003   copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity
2024-08-19T05:37:13,005   copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity
2024-08-19T05:37:13,007   copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity
2024-08-19T05:37:13,010   copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity
2024-08-19T05:37:13,012   copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity
2024-08-19T05:37:13,013   copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity
2024-08-19T05:37:13,016   creating build/lib/deepspeed/inference
2024-08-19T05:37:13,017   copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference
2024-08-19T05:37:13,019   copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference
2024-08-19T05:37:13,022   copying deepspeed/inference/config.py -> build/lib/deepspeed/inference
2024-08-19T05:37:13,025   creating build/lib/deepspeed/nebula
2024-08-19T05:37:13,026   copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula
2024-08-19T05:37:13,028   copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula
2024-08-19T05:37:13,029   copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula
2024-08-19T05:37:13,032   creating build/lib/deepspeed/linear
2024-08-19T05:37:13,033   copying deepspeed/linear/optimized_linear.py -> build/lib/deepspeed/linear
2024-08-19T05:37:13,035   copying deepspeed/linear/quantization.py -> build/lib/deepspeed/linear
2024-08-19T05:37:13,037   copying deepspeed/linear/context_manager.py -> build/lib/deepspeed/linear
2024-08-19T05:37:13,039   copying deepspeed/linear/__init__.py -> build/lib/deepspeed/linear
2024-08-19T05:37:13,041   copying deepspeed/linear/config.py -> build/lib/deepspeed/linear
2024-08-19T05:37:13,044   creating build/lib/deepspeed/launcher
2024-08-19T05:37:13,044   copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher
2024-08-19T05:37:13,047   copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher
2024-08-19T05:37:13,048   copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher
2024-08-19T05:37:13,051   copying deepspeed/launcher/launcher_helper.py -> build/lib/deepspeed/launcher
2024-08-19T05:37:13,053   copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher
2024-08-19T05:37:13,055   copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher
2024-08-19T05:37:13,057   creating build/lib/deepspeed/ops
2024-08-19T05:37:13,058   copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops
2024-08-19T05:37:13,061   creating build/lib/deepspeed/autotuning/tuner
2024-08-19T05:37:13,061   copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner
2024-08-19T05:37:13,063   copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-08-19T05:37:13,065   copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-08-19T05:37:13,067   copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner
2024-08-19T05:37:13,069   copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner
2024-08-19T05:37:13,071   copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner
2024-08-19T05:37:13,073   creating build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,074   copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,076   copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,077   copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,079   copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,081   copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,083   copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,084   copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,087   copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,088   copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,090   copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers
2024-08-19T05:37:13,093   creating build/lib/deepspeed/model_implementations/features
2024-08-19T05:37:13,093   copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features
2024-08-19T05:37:13,095   copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features
2024-08-19T05:37:13,097   creating build/lib/deepspeed/model_implementations/diffusers
2024-08-19T05:37:13,098   copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers
2024-08-19T05:37:13,100   copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers
2024-08-19T05:37:13,102   copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers
2024-08-19T05:37:13,105   creating build/lib/deepspeed/runtime/activation_checkpointing
2024-08-19T05:37:13,106   copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-08-19T05:37:13,108   copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-08-19T05:37:13,111   copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing
2024-08-19T05:37:13,113   creating build/lib/deepspeed/runtime/data_pipeline
2024-08-19T05:37:13,114   copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline
2024-08-19T05:37:13,116   copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline
2024-08-19T05:37:13,118   copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline
2024-08-19T05:37:13,120   copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline
2024-08-19T05:37:13,122   creating build/lib/deepspeed/runtime/comm
2024-08-19T05:37:13,123   copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm
2024-08-19T05:37:13,126   copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm
2024-08-19T05:37:13,128   copying deepspeed/runtime/comm/compressed.py -> build/lib/deepspeed/runtime/comm
2024-08-19T05:37:13,129   copying deepspeed/runtime/comm/hccl.py -> build/lib/deepspeed/runtime/comm
2024-08-19T05:37:13,131   copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm
2024-08-19T05:37:13,133   copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm
2024-08-19T05:37:13,135   creating build/lib/deepspeed/runtime/compression
2024-08-19T05:37:13,137   copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression
2024-08-19T05:37:13,139   copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression
2024-08-19T05:37:13,141   creating build/lib/deepspeed/runtime/fp16
2024-08-19T05:37:13,142   copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16
2024-08-19T05:37:13,144   copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16
2024-08-19T05:37:13,146   copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-08-19T05:37:13,149   copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16
2024-08-19T05:37:13,152   creating build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,153   copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,155   copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,157   copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,161   copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,163   copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,165   copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,170   copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,174   copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,176   copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,178   copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,181   copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,183   copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,186   copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,188   copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,190   copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,193   copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero
2024-08-19T05:37:13,196   creating build/lib/deepspeed/runtime/pipe
2024-08-19T05:37:13,197   copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe
2024-08-19T05:37:13,199   copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe
2024-08-19T05:37:13,202   copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe
2024-08-19T05:37:13,203   copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe
2024-08-19T05:37:13,207   copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe
2024-08-19T05:37:13,209   copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe
2024-08-19T05:37:13,213   creating build/lib/deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:13,214   copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:13,216   copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:13,218   copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:13,220   copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:13,222   creating build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,223   copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,226   copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,228   copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,230   copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,232   copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,235   copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,237   copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,239   copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,241   copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor
2024-08-19T05:37:13,244   creating build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:13,245   copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:13,247   copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:13,249   copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:13,251   copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:13,253   copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:13,256   creating build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:13,257   copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:13,259   copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:13,262   copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:13,265   copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:13,266   copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:13,270   creating build/lib/deepspeed/runtime/fp16/onebit
2024-08-19T05:37:13,271   copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-08-19T05:37:13,273   copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-08-19T05:37:13,275   copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-08-19T05:37:13,278   copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit
2024-08-19T05:37:13,282   creating build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,283   copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,285   copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,287   copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,290   copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,291   copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,294   copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,296   copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,298   copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,300   copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,302   copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,304   copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,306   copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,308   copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,310   copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,313   copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,315   copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,317   copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,319   copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,321   copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers
2024-08-19T05:37:13,324   creating build/lib/deepspeed/module_inject/containers/features
2024-08-19T05:37:13,325   copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-19T05:37:13,327   copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-19T05:37:13,330   copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-19T05:37:13,332   copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-19T05:37:13,334   copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-19T05:37:13,336   copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-19T05:37:13,338   copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features
2024-08-19T05:37:13,341   creating build/lib/deepspeed/profiling/flops_profiler
2024-08-19T05:37:13,342   copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler
2024-08-19T05:37:13,345   copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler
2024-08-19T05:37:13,348   creating build/lib/deepspeed/inference/quantization
2024-08-19T05:37:13,349   copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization
2024-08-19T05:37:13,351   copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization
2024-08-19T05:37:13,353   copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization
2024-08-19T05:37:13,356   copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization
2024-08-19T05:37:13,358   copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization
2024-08-19T05:37:13,360   creating build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,361   copying deepspeed/inference/v2/inference_parameter.py -> build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,363   copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,365   copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,367   copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,369   copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,371   copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,373   copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,375   copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,377   copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2
2024-08-19T05:37:13,380   creating build/lib/deepspeed/inference/v2/model_implementations
2024-08-19T05:37:13,381   copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-19T05:37:13,384   copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-19T05:37:13,387   copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-19T05:37:13,389   copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-19T05:37:13,391   copying deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-19T05:37:13,394   copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-19T05:37:13,396   copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations
2024-08-19T05:37:13,399   creating build/lib/deepspeed/inference/v2/checkpoint
2024-08-19T05:37:13,400   copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-08-19T05:37:13,403   copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-08-19T05:37:13,405   copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-08-19T05:37:13,406   copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint
2024-08-19T05:37:13,409   creating build/lib/deepspeed/inference/v2/ragged
2024-08-19T05:37:13,410   copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-19T05:37:13,412   copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-19T05:37:13,414   copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-19T05:37:13,416   copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-19T05:37:13,418   copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-19T05:37:13,421   copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-19T05:37:13,423   copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged
2024-08-19T05:37:13,425   creating build/lib/deepspeed/inference/v2/kernels
2024-08-19T05:37:13,426   copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels
2024-08-19T05:37:13,428   copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels
2024-08-19T05:37:13,430   creating build/lib/deepspeed/inference/v2/modules
2024-08-19T05:37:13,431   copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules
2024-08-19T05:37:13,434   copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules
2024-08-19T05:37:13,435   copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules
2024-08-19T05:37:13,437   copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules
2024-08-19T05:37:13,439   creating build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:13,441   copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:13,443   copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:13,445   copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:13,446   copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:13,449   creating build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,451   copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,453   copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,455   copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,457   copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,459   copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,461   copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,463   copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,465   copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,467   copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:13,470   creating build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:13,470   copying deepspeed/inference/v2/model_implementations/phi/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:13,472   copying deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:13,474   copying deepspeed/inference/v2/model_implementations/phi/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:13,476   copying deepspeed/inference/v2/model_implementations/phi/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:13,479   creating build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:13,480   copying deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:13,482   copying deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:13,483   copying deepspeed/inference/v2/model_implementations/qwen/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:13,485   copying deepspeed/inference/v2/model_implementations/qwen/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:13,488   creating build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:13,489   copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:13,491   copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:13,493   copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:13,495   copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:13,498   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:13,499   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:13,501   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:13,503   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:13,505   copying deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:13,508   creating build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:13,509   copying deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:13,511   copying deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:13,513   copying deepspeed/inference/v2/model_implementations/phi3/model.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:13,516   copying deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/lib/deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:13,518   creating build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:13,520   copying deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:13,522   copying deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:13,524   copying deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:13,525   copying deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:13,528   creating build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:13,529   copying deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:13,531   copying deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:13,534   copying deepspeed/inference/v2/model_implementations/falcon/container.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:13,537   copying deepspeed/inference/v2/model_implementations/falcon/model.py -> build/lib/deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:13,540   creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:13,541   copying deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:13,543   copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:13,545   copying deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:13,548   copying deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:13,551   creating build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:13,552   copying deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:13,554   copying deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:13,556   copying deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:13,559   copying deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/lib/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:13,563   creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,564   copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,566   copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,569   copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,571   copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,574   copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,576   copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,578   copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,580   copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,582   copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:13,585   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-08-19T05:37:13,586   copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-08-19T05:37:13,589   creating build/lib/deepspeed/inference/v2/kernels/core_ops
2024-08-19T05:37:13,590   copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-08-19T05:37:13,593   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-08-19T05:37:13,594   copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-08-19T05:37:13,597   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:13,598   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:13,601   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:13,603   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:13,605   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:13,607   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:13,609   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:13,612   creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:13,613   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:13,615   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:13,618   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:13,620   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:13,622   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:13,624   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:13,626   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:13,629   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:13,631   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:13,633   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:13,635   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:13,638   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:13,640   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:13,642   creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:13,644   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:13,646   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:13,649   creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:13,650   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:13,652   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:13,655   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:13,656   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:13,658   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:13,661   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:13,662   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:13,665   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:13,667   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:13,668   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:13,670   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:13,673   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:13,674   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:13,676   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:13,678   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:13,679   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:13,681   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:13,684   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:13,685   copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:13,687   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:13,689   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:13,690   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:13,692   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:13,694   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:13,696   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:13,698   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:13,699   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:13,701   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:13,703   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:13,704   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:13,706   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:13,709   creating build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:13,710   copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:13,712   copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:13,714   copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:13,716   copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:13,718   copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:13,720   copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:13,722   copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:13,724   copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:13,726   creating build/lib/deepspeed/inference/v2/modules/implementations
2024-08-19T05:37:13,728   copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations
2024-08-19T05:37:13,730   creating build/lib/deepspeed/inference/v2/modules/configs
2024-08-19T05:37:13,731   copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-19T05:37:13,734   copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-19T05:37:13,735   copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-19T05:37:13,737   copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-19T05:37:13,739   copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-19T05:37:13,741   copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-19T05:37:13,743   copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs
2024-08-19T05:37:13,745   creating build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-08-19T05:37:13,746   copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-08-19T05:37:13,749   copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe
2024-08-19T05:37:13,751   creating build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-08-19T05:37:13,752   copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-08-19T05:37:13,754   copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed
2024-08-19T05:37:13,757   creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-08-19T05:37:13,758   copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-08-19T05:37:13,760   copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm
2024-08-19T05:37:13,762   creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-19T05:37:13,763   copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-19T05:37:13,765   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-19T05:37:13,767   copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-19T05:37:13,769   creating build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-08-19T05:37:13,770   copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-08-19T05:37:13,772   copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding
2024-08-19T05:37:13,775   creating build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-08-19T05:37:13,776   copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-08-19T05:37:13,778   copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-08-19T05:37:13,780   copying deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear
2024-08-19T05:37:13,782   creating build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-08-19T05:37:13,783   copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-08-19T05:37:13,786   copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention
2024-08-19T05:37:13,789   creating build/lib/deepspeed/ops/random_ltd
2024-08-19T05:37:13,789   copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd
2024-08-19T05:37:13,791   copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd
2024-08-19T05:37:13,794   creating build/lib/deepspeed/ops/fp_quantizer
2024-08-19T05:37:13,795   copying deepspeed/ops/fp_quantizer/__init__.py -> build/lib/deepspeed/ops/fp_quantizer
2024-08-19T05:37:13,797   copying deepspeed/ops/fp_quantizer/quantize.py -> build/lib/deepspeed/ops/fp_quantizer
2024-08-19T05:37:13,800   copying deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/lib/deepspeed/ops/fp_quantizer
2024-08-19T05:37:13,802   creating build/lib/deepspeed/ops/lion
2024-08-19T05:37:13,803   copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion
2024-08-19T05:37:13,805   copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion
2024-08-19T05:37:13,807   copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion
2024-08-19T05:37:13,809   copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion
2024-08-19T05:37:13,811   creating build/lib/deepspeed/ops/adam
2024-08-19T05:37:13,812   copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam
2024-08-19T05:37:13,814   copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam
2024-08-19T05:37:13,816   copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam
2024-08-19T05:37:13,818   copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam
2024-08-19T05:37:13,826   creating build/lib/deepspeed/ops/sparse_attention
2024-08-19T05:37:13,827   copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-19T05:37:13,830   copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-19T05:37:13,832   copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-19T05:37:13,835   copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-19T05:37:13,837   copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-19T05:37:13,839   copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-19T05:37:13,841   copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention
2024-08-19T05:37:13,844   creating build/lib/deepspeed/ops/adagrad
2024-08-19T05:37:13,845   copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad
2024-08-19T05:37:13,847   copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad
2024-08-19T05:37:13,850   creating build/lib/deepspeed/ops/quantizer
2024-08-19T05:37:13,851   copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer
2024-08-19T05:37:13,853   copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer
2024-08-19T05:37:13,855   creating build/lib/deepspeed/ops/lamb
2024-08-19T05:37:13,856   copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb
2024-08-19T05:37:13,858   copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb
2024-08-19T05:37:13,860   creating build/lib/deepspeed/ops/aio
2024-08-19T05:37:13,861   copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio
2024-08-19T05:37:13,864   creating build/lib/deepspeed/ops/transformer
2024-08-19T05:37:13,865   copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer
2024-08-19T05:37:13,867   copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer
2024-08-19T05:37:13,870   creating build/lib/deepspeed/ops/deepspeed4science
2024-08-19T05:37:13,871   copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science
2024-08-19T05:37:13,873   copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science
2024-08-19T05:37:13,876   creating build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,877   copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,879   copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,881   copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,883   copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,885   copying deepspeed/ops/op_builder/fp_quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,887   copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,889   copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,891   copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,892   copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,894   copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,896   copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,898   copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,899   copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,901   copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,903   copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,905   copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,907   copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,909   copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,910   copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,912   copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,914   copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,917   copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,919   copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder
2024-08-19T05:37:13,922   creating build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:13,922   copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:13,925   creating build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,926   copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,929   copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,930   copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,933   copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,935   copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,937   copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,939   copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,942   copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,944   copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,946   copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference
2024-08-19T05:37:13,949   creating build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,950   copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,953   copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,955   copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,957   copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,959   copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,961   copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,964   copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,966   copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,968   copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,970   copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:13,973   creating build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,974   copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,977   copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,979   copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,981   copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,983   copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,985   copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,987   copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,989   copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,990   copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,993   copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:13,995   creating build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:13,997   copying deepspeed/ops/op_builder/npu/async_io.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:13,999   copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:14,001   copying deepspeed/ops/op_builder/npu/inference.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:14,003   copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:14,005   copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:14,007   copying deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:14,009   copying deepspeed/ops/op_builder/npu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:14,011   copying deepspeed/ops/op_builder/npu/cpu_lion.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:14,013   copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu
2024-08-19T05:37:14,016   creating build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,017   copying deepspeed/ops/op_builder/xpu/flash_attn.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,019   copying deepspeed/ops/op_builder/xpu/async_io.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,021   copying deepspeed/ops/op_builder/xpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,022   copying deepspeed/ops/op_builder/xpu/inference.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,024   copying deepspeed/ops/op_builder/xpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,026   copying deepspeed/ops/op_builder/xpu/__init__.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,028   copying deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,029   copying deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,031   copying deepspeed/ops/op_builder/xpu/packbits.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,033   copying deepspeed/ops/op_builder/xpu/builder.py -> build/lib/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:14,036   creating build/lib/deepspeed/ops/op_builder/cpu
2024-08-19T05:37:14,037   copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-19T05:37:14,039   copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-19T05:37:14,041   copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-19T05:37:14,043   copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-19T05:37:14,045   copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-19T05:37:14,046   copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu
2024-08-19T05:37:14,049   creating build/lib/deepspeed/ops/op_builder/hpu
2024-08-19T05:37:14,050   copying deepspeed/ops/op_builder/hpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-19T05:37:14,052   copying deepspeed/ops/op_builder/hpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-19T05:37:14,054   copying deepspeed/ops/op_builder/hpu/__init__.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-19T05:37:14,056   copying deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-19T05:37:14,057   copying deepspeed/ops/op_builder/hpu/builder.py -> build/lib/deepspeed/ops/op_builder/hpu
2024-08-19T05:37:14,060   running egg_info
2024-08-19T05:37:14,087   writing deepspeed.egg-info/PKG-INFO
2024-08-19T05:37:14,120   writing dependency_links to deepspeed.egg-info/dependency_links.txt
2024-08-19T05:37:14,122   writing entry points to deepspeed.egg-info/entry_points.txt
2024-08-19T05:37:14,139   writing requirements to deepspeed.egg-info/requires.txt
2024-08-19T05:37:14,141   writing top-level names to deepspeed.egg-info/top_level.txt
2024-08-19T05:37:14,266   reading manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-08-19T05:37:14,326   reading manifest template 'MANIFEST.in'
2024-08-19T05:37:14,328   warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so'
2024-08-19T05:37:14,329   warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so'
2024-08-19T05:37:15,898   warning: no files found matching '*.hip' under directory 'deepspeed'
2024-08-19T05:37:16,844   warning: no files found matching '*.cc' under directory 'deepspeed'
2024-08-19T05:37:17,447   warning: no files found matching '*.tr' under directory 'csrc'
2024-08-19T05:37:17,578   warning: no files found matching '*.cc' under directory 'csrc'
2024-08-19T05:37:17,628   warning: no files found matching '*.py' under directory 'benchmarks'
2024-08-19T05:37:17,635   adding license file 'LICENSE'
2024-08-19T05:37:17,702   writing manifest file 'deepspeed.egg-info/SOURCES.txt'
2024-08-19T05:37:17,712   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration.
2024-08-19T05:37:17,713   !!

2024-08-19T05:37:17,714           ********************************************************************************
2024-08-19T05:37:17,714           ############################
2024-08-19T05:37:17,715           # Package would be ignored #
2024-08-19T05:37:17,715           ############################
2024-08-19T05:37:17,716           Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1],
2024-08-19T05:37:17,716           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,717           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,718           package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added
2024-08-19T05:37:17,718           to the `packages` configuration field.

2024-08-19T05:37:17,719           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,720           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,720           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,721           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,722           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,723           If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are
2024-08-19T05:37:17,724           already explicitly excluding 'deepspeed.autotuning.config_templates' via
2024-08-19T05:37:17,724           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,725           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,725           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,726           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,727           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,729           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,729                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,729                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,730                 directory, all directories are treated like packages.
2024-08-19T05:37:17,730           ********************************************************************************

2024-08-19T05:37:17,731   !!
2024-08-19T05:37:17,732     check.warn(importable)
2024-08-19T05:37:17,732   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is absent from the `packages` configuration.
2024-08-19T05:37:17,733   !!

2024-08-19T05:37:17,734           ********************************************************************************
2024-08-19T05:37:17,734           ############################
2024-08-19T05:37:17,735           # Package would be ignored #
2024-08-19T05:37:17,736           ############################
2024-08-19T05:37:17,736           Python recognizes 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' as an importable package[^1],
2024-08-19T05:37:17,736           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,737           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,738           package, please make sure that 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' is explicitly added
2024-08-19T05:37:17,739           to the `packages` configuration field.

2024-08-19T05:37:17,739           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,740           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,740           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,741           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,742           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,742           If you don't want 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' to be distributed and are
2024-08-19T05:37:17,743           already explicitly excluding 'deepspeed.inference.v2.kernels.core_ops.cuda_linear.include' via
2024-08-19T05:37:17,743           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,743           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,744           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,744           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,745           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,746           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,747                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,747                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,747                 directory, all directories are treated like packages.
2024-08-19T05:37:17,748           ********************************************************************************

2024-08-19T05:37:17,749   !!
2024-08-19T05:37:17,749     check.warn(importable)
2024-08-19T05:37:17,749   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration.
2024-08-19T05:37:17,750   !!

2024-08-19T05:37:17,751           ********************************************************************************
2024-08-19T05:37:17,751           ############################
2024-08-19T05:37:17,752           # Package would be ignored #
2024-08-19T05:37:17,752           ############################
2024-08-19T05:37:17,753           Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1],
2024-08-19T05:37:17,753           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,754           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,754           package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added
2024-08-19T05:37:17,755           to the `packages` configuration field.

2024-08-19T05:37:17,756           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,756           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,757           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,758           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,758           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,759           If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are
2024-08-19T05:37:17,760           already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via
2024-08-19T05:37:17,760           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,761           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,762           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,762           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,763           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,764           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,764                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,765                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,765                 directory, all directories are treated like packages.
2024-08-19T05:37:17,766           ********************************************************************************

2024-08-19T05:37:17,766   !!
2024-08-19T05:37:17,767     check.warn(importable)
2024-08-19T05:37:17,767   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration.
2024-08-19T05:37:17,767   !!

2024-08-19T05:37:17,768           ********************************************************************************
2024-08-19T05:37:17,769           ############################
2024-08-19T05:37:17,769           # Package would be ignored #
2024-08-19T05:37:17,769           ############################
2024-08-19T05:37:17,770           Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1],
2024-08-19T05:37:17,770           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,771           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,771           package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added
2024-08-19T05:37:17,772           to the `packages` configuration field.

2024-08-19T05:37:17,773           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,773           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,774           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,775           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,776           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,777           If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are
2024-08-19T05:37:17,777           already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via
2024-08-19T05:37:17,778           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,778           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,778           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,779           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,780           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,782           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,782                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,782                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,783                 directory, all directories are treated like packages.
2024-08-19T05:37:17,783           ********************************************************************************

2024-08-19T05:37:17,784   !!
2024-08-19T05:37:17,785     check.warn(importable)
2024-08-19T05:37:17,785   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.includes' is absent from the `packages` configuration.
2024-08-19T05:37:17,786   !!

2024-08-19T05:37:17,787           ********************************************************************************
2024-08-19T05:37:17,787           ############################
2024-08-19T05:37:17,788           # Package would be ignored #
2024-08-19T05:37:17,788           ############################
2024-08-19T05:37:17,788           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.includes' as an importable package[^1],
2024-08-19T05:37:17,789           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,790           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,790           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.includes' is explicitly added
2024-08-19T05:37:17,790           to the `packages` configuration field.

2024-08-19T05:37:17,791           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,791           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,792           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,793           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,793           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,794           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.includes' to be distributed and are
2024-08-19T05:37:17,794           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.includes' via
2024-08-19T05:37:17,795           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,795           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,796           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,797           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,798           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,799           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,800                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,800                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,801                 directory, all directories are treated like packages.
2024-08-19T05:37:17,801           ********************************************************************************

2024-08-19T05:37:17,802   !!
2024-08-19T05:37:17,802     check.warn(importable)
2024-08-19T05:37:17,803   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration.
2024-08-19T05:37:17,803   !!

2024-08-19T05:37:17,804           ********************************************************************************
2024-08-19T05:37:17,805           ############################
2024-08-19T05:37:17,805           # Package would be ignored #
2024-08-19T05:37:17,805           ############################
2024-08-19T05:37:17,806           Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1],
2024-08-19T05:37:17,806           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,807           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,808           package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added
2024-08-19T05:37:17,808           to the `packages` configuration field.

2024-08-19T05:37:17,809           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,809           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,810           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,811           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,812           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,812           If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are
2024-08-19T05:37:17,813           already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via
2024-08-19T05:37:17,813           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,813           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,814           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,815           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,815           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,817           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,817                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,817                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,818                 directory, all directories are treated like packages.
2024-08-19T05:37:17,818           ********************************************************************************

2024-08-19T05:37:17,819   !!
2024-08-19T05:37:17,820     check.warn(importable)
2024-08-19T05:37:17,820   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration.
2024-08-19T05:37:17,821   !!

2024-08-19T05:37:17,821           ********************************************************************************
2024-08-19T05:37:17,822           ############################
2024-08-19T05:37:17,822           # Package would be ignored #
2024-08-19T05:37:17,823           ############################
2024-08-19T05:37:17,823           Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1],
2024-08-19T05:37:17,823           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,824           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,825           package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added
2024-08-19T05:37:17,825           to the `packages` configuration field.

2024-08-19T05:37:17,826           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,827           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,827           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,828           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,829           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,830           If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are
2024-08-19T05:37:17,830           already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via
2024-08-19T05:37:17,831           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,831           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,832           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,833           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,833           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,835           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,835                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,836                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,836                 directory, all directories are treated like packages.
2024-08-19T05:37:17,836           ********************************************************************************

2024-08-19T05:37:17,837   !!
2024-08-19T05:37:17,837     check.warn(importable)
2024-08-19T05:37:17,838   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration.
2024-08-19T05:37:17,838   !!

2024-08-19T05:37:17,839           ********************************************************************************
2024-08-19T05:37:17,839           ############################
2024-08-19T05:37:17,840           # Package would be ignored #
2024-08-19T05:37:17,840           ############################
2024-08-19T05:37:17,840           Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1],
2024-08-19T05:37:17,841           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,842           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,842           package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added
2024-08-19T05:37:17,842           to the `packages` configuration field.

2024-08-19T05:37:17,843           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,844           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,844           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,845           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,846           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,847           If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are
2024-08-19T05:37:17,847           already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via
2024-08-19T05:37:17,848           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,848           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,849           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,849           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,850           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,852           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,852                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,853                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,853                 directory, all directories are treated like packages.
2024-08-19T05:37:17,853           ********************************************************************************

2024-08-19T05:37:17,854   !!
2024-08-19T05:37:17,855     check.warn(importable)
2024-08-19T05:37:17,855   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration.
2024-08-19T05:37:17,856   !!

2024-08-19T05:37:17,857           ********************************************************************************
2024-08-19T05:37:17,857           ############################
2024-08-19T05:37:17,858           # Package would be ignored #
2024-08-19T05:37:17,858           ############################
2024-08-19T05:37:17,858           Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1],
2024-08-19T05:37:17,860           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,860           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,861           package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added
2024-08-19T05:37:17,861           to the `packages` configuration field.

2024-08-19T05:37:17,862           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,862           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,862           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,863           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,864           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,865           If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are
2024-08-19T05:37:17,866           already explicitly excluding 'deepspeed.ops.csrc.adagrad' via
2024-08-19T05:37:17,866           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,866           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,867           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,868           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,869           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,870           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,870                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,870                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,871                 directory, all directories are treated like packages.
2024-08-19T05:37:17,871           ********************************************************************************

2024-08-19T05:37:17,872   !!
2024-08-19T05:37:17,873     check.warn(importable)
2024-08-19T05:37:17,873   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration.
2024-08-19T05:37:17,874   !!

2024-08-19T05:37:17,874           ********************************************************************************
2024-08-19T05:37:17,875           ############################
2024-08-19T05:37:17,875           # Package would be ignored #
2024-08-19T05:37:17,876           ############################
2024-08-19T05:37:17,876           Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1],
2024-08-19T05:37:17,877           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,878           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,878           package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added
2024-08-19T05:37:17,878           to the `packages` configuration field.

2024-08-19T05:37:17,879           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,880           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,880           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,881           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,882           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,883           If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are
2024-08-19T05:37:17,883           already explicitly excluding 'deepspeed.ops.csrc.adam' via
2024-08-19T05:37:17,884           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,884           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,885           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,886           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,887           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,888           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,888                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,889                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,889                 directory, all directories are treated like packages.
2024-08-19T05:37:17,889           ********************************************************************************

2024-08-19T05:37:17,890   !!
2024-08-19T05:37:17,890     check.warn(importable)
2024-08-19T05:37:17,891   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration.
2024-08-19T05:37:17,891   !!

2024-08-19T05:37:17,892           ********************************************************************************
2024-08-19T05:37:17,892           ############################
2024-08-19T05:37:17,893           # Package would be ignored #
2024-08-19T05:37:17,893           ############################
2024-08-19T05:37:17,894           Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1],
2024-08-19T05:37:17,894           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,895           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,896           package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added
2024-08-19T05:37:17,896           to the `packages` configuration field.

2024-08-19T05:37:17,897           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,897           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,898           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,899           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,900           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,900           If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are
2024-08-19T05:37:17,901           already explicitly excluding 'deepspeed.ops.csrc.aio.common' via
2024-08-19T05:37:17,901           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,902           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,902           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,903           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,904           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,905           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,906                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,906                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,907                 directory, all directories are treated like packages.
2024-08-19T05:37:17,907           ********************************************************************************

2024-08-19T05:37:17,908   !!
2024-08-19T05:37:17,909     check.warn(importable)
2024-08-19T05:37:17,909   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration.
2024-08-19T05:37:17,910   !!

2024-08-19T05:37:17,911           ********************************************************************************
2024-08-19T05:37:17,911           ############################
2024-08-19T05:37:17,912           # Package would be ignored #
2024-08-19T05:37:17,912           ############################
2024-08-19T05:37:17,912           Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1],
2024-08-19T05:37:17,913           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,913           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,914           package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added
2024-08-19T05:37:17,914           to the `packages` configuration field.

2024-08-19T05:37:17,915           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,915           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,916           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,916           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,917           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,918           If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are
2024-08-19T05:37:17,918           already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via
2024-08-19T05:37:17,919           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,919           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,920           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,921           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,921           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,923           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,923                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,924                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,924                 directory, all directories are treated like packages.
2024-08-19T05:37:17,924           ********************************************************************************

2024-08-19T05:37:17,925   !!
2024-08-19T05:37:17,926     check.warn(importable)
2024-08-19T05:37:17,926   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration.
2024-08-19T05:37:17,927   !!

2024-08-19T05:37:17,928           ********************************************************************************
2024-08-19T05:37:17,928           ############################
2024-08-19T05:37:17,929           # Package would be ignored #
2024-08-19T05:37:17,929           ############################
2024-08-19T05:37:17,929           Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1],
2024-08-19T05:37:17,930           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,931           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,931           package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added
2024-08-19T05:37:17,932           to the `packages` configuration field.

2024-08-19T05:37:17,933           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,933           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,934           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,935           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,936           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,937           If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are
2024-08-19T05:37:17,937           already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via
2024-08-19T05:37:17,937           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,938           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,938           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,939           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,940           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,941           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,941                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,942                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,942                 directory, all directories are treated like packages.
2024-08-19T05:37:17,942           ********************************************************************************

2024-08-19T05:37:17,943   !!
2024-08-19T05:37:17,943     check.warn(importable)
2024-08-19T05:37:17,944   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration.
2024-08-19T05:37:17,944   !!

2024-08-19T05:37:17,945           ********************************************************************************
2024-08-19T05:37:17,946           ############################
2024-08-19T05:37:17,946           # Package would be ignored #
2024-08-19T05:37:17,946           ############################
2024-08-19T05:37:17,947           Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1],
2024-08-19T05:37:17,947           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,948           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,948           package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added
2024-08-19T05:37:17,949           to the `packages` configuration field.

2024-08-19T05:37:17,950           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,950           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,951           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,951           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,952           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,953           If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are
2024-08-19T05:37:17,954           already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via
2024-08-19T05:37:17,954           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,954           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,955           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,956           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,957           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,958           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,958                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,959                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,959                 directory, all directories are treated like packages.
2024-08-19T05:37:17,960           ********************************************************************************

2024-08-19T05:37:17,961   !!
2024-08-19T05:37:17,961     check.warn(importable)
2024-08-19T05:37:17,962   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration.
2024-08-19T05:37:17,962   !!

2024-08-19T05:37:17,963           ********************************************************************************
2024-08-19T05:37:17,963           ############################
2024-08-19T05:37:17,963           # Package would be ignored #
2024-08-19T05:37:17,964           ############################
2024-08-19T05:37:17,964           Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1],
2024-08-19T05:37:17,965           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,965           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,966           package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added
2024-08-19T05:37:17,966           to the `packages` configuration field.

2024-08-19T05:37:17,967           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,967           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,967           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,968           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,969           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,970           If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are
2024-08-19T05:37:17,970           already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via
2024-08-19T05:37:17,971           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,971           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,972           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,973           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,974           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,975           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,975                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,976                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,976                 directory, all directories are treated like packages.
2024-08-19T05:37:17,977           ********************************************************************************

2024-08-19T05:37:17,978   !!
2024-08-19T05:37:17,978     check.warn(importable)
2024-08-19T05:37:17,978   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration.
2024-08-19T05:37:17,979   !!

2024-08-19T05:37:17,980           ********************************************************************************
2024-08-19T05:37:17,980           ############################
2024-08-19T05:37:17,981           # Package would be ignored #
2024-08-19T05:37:17,981           ############################
2024-08-19T05:37:17,982           Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1],
2024-08-19T05:37:17,982           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,983           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:17,983           package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added
2024-08-19T05:37:17,984           to the `packages` configuration field.

2024-08-19T05:37:17,985           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:17,985           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:17,986           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:17,986           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:17,987           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:17,988           If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are
2024-08-19T05:37:17,988           already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via
2024-08-19T05:37:17,988           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:17,989           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:17,989           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:17,990           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:17,991           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:17,992           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:17,992                 even if it does not contain any `.py` files.
2024-08-19T05:37:17,993                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:17,993                 directory, all directories are treated like packages.
2024-08-19T05:37:17,993           ********************************************************************************

2024-08-19T05:37:17,994   !!
2024-08-19T05:37:17,995     check.warn(importable)
2024-08-19T05:37:17,995   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration.
2024-08-19T05:37:17,995   !!

2024-08-19T05:37:17,996           ********************************************************************************
2024-08-19T05:37:17,997           ############################
2024-08-19T05:37:17,997           # Package would be ignored #
2024-08-19T05:37:17,998           ############################
2024-08-19T05:37:17,998           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1],
2024-08-19T05:37:17,998           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:17,999           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,000           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added
2024-08-19T05:37:18,000           to the `packages` configuration field.

2024-08-19T05:37:18,001           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,002           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,002           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,003           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,004           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,005           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are
2024-08-19T05:37:18,006           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via
2024-08-19T05:37:18,006           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,007           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,007           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,008           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,009           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,010           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,010                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,011                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,011                 directory, all directories are treated like packages.
2024-08-19T05:37:18,012           ********************************************************************************

2024-08-19T05:37:18,012   !!
2024-08-19T05:37:18,013     check.warn(importable)
2024-08-19T05:37:18,013   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration.
2024-08-19T05:37:18,013   !!

2024-08-19T05:37:18,014           ********************************************************************************
2024-08-19T05:37:18,015           ############################
2024-08-19T05:37:18,015           # Package would be ignored #
2024-08-19T05:37:18,015           ############################
2024-08-19T05:37:18,016           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1],
2024-08-19T05:37:18,016           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,017           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,017           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added
2024-08-19T05:37:18,018           to the `packages` configuration field.

2024-08-19T05:37:18,019           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,020           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,020           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,021           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,022           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,023           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are
2024-08-19T05:37:18,023           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via
2024-08-19T05:37:18,024           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,024           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,025           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,026           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,026           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,028           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,028                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,029                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,029                 directory, all directories are treated like packages.
2024-08-19T05:37:18,030           ********************************************************************************

2024-08-19T05:37:18,030   !!
2024-08-19T05:37:18,031     check.warn(importable)
2024-08-19T05:37:18,031   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration.
2024-08-19T05:37:18,032   !!

2024-08-19T05:37:18,033           ********************************************************************************
2024-08-19T05:37:18,033           ############################
2024-08-19T05:37:18,034           # Package would be ignored #
2024-08-19T05:37:18,034           ############################
2024-08-19T05:37:18,034           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1],
2024-08-19T05:37:18,035           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,035           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,036           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added
2024-08-19T05:37:18,036           to the `packages` configuration field.

2024-08-19T05:37:18,037           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,037           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,038           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,038           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,039           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,040           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are
2024-08-19T05:37:18,040           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via
2024-08-19T05:37:18,041           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,041           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,041           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,042           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,043           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,045           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,045                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,045                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,046                 directory, all directories are treated like packages.
2024-08-19T05:37:18,046           ********************************************************************************

2024-08-19T05:37:18,047   !!
2024-08-19T05:37:18,047     check.warn(importable)
2024-08-19T05:37:18,048   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration.
2024-08-19T05:37:18,049   !!

2024-08-19T05:37:18,049           ********************************************************************************
2024-08-19T05:37:18,050           ############################
2024-08-19T05:37:18,050           # Package would be ignored #
2024-08-19T05:37:18,051           ############################
2024-08-19T05:37:18,051           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1],
2024-08-19T05:37:18,052           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,053           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,053           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added
2024-08-19T05:37:18,053           to the `packages` configuration field.

2024-08-19T05:37:18,054           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,055           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,055           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,056           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,057           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,058           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are
2024-08-19T05:37:18,058           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via
2024-08-19T05:37:18,059           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,059           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,059           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,060           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,061           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,062           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,062                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,063                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,063                 directory, all directories are treated like packages.
2024-08-19T05:37:18,064           ********************************************************************************

2024-08-19T05:37:18,065   !!
2024-08-19T05:37:18,065     check.warn(importable)
2024-08-19T05:37:18,066   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration.
2024-08-19T05:37:18,066   !!

2024-08-19T05:37:18,067           ********************************************************************************
2024-08-19T05:37:18,067           ############################
2024-08-19T05:37:18,068           # Package would be ignored #
2024-08-19T05:37:18,068           ############################
2024-08-19T05:37:18,069           Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1],
2024-08-19T05:37:18,069           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,070           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,070           package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added
2024-08-19T05:37:18,071           to the `packages` configuration field.

2024-08-19T05:37:18,072           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,072           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,072           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,073           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,074           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,075           If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are
2024-08-19T05:37:18,076           already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via
2024-08-19T05:37:18,076           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,077           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,077           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,078           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,079           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,080           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,080                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,081                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,081                 directory, all directories are treated like packages.
2024-08-19T05:37:18,081           ********************************************************************************

2024-08-19T05:37:18,082   !!
2024-08-19T05:37:18,082     check.warn(importable)
2024-08-19T05:37:18,083   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer' is absent from the `packages` configuration.
2024-08-19T05:37:18,083   !!

2024-08-19T05:37:18,084           ********************************************************************************
2024-08-19T05:37:18,084           ############################
2024-08-19T05:37:18,085           # Package would be ignored #
2024-08-19T05:37:18,085           ############################
2024-08-19T05:37:18,086           Python recognizes 'deepspeed.ops.csrc.fp_quantizer' as an importable package[^1],
2024-08-19T05:37:18,086           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,087           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,087           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer' is explicitly added
2024-08-19T05:37:18,087           to the `packages` configuration field.

2024-08-19T05:37:18,088           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,089           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,089           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,090           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,091           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,091           If you don't want 'deepspeed.ops.csrc.fp_quantizer' to be distributed and are
2024-08-19T05:37:18,092           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer' via
2024-08-19T05:37:18,092           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,093           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,093           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,094           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,095           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,096           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,097                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,097                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,098                 directory, all directories are treated like packages.
2024-08-19T05:37:18,098           ********************************************************************************

2024-08-19T05:37:18,099   !!
2024-08-19T05:37:18,099     check.warn(importable)
2024-08-19T05:37:18,100   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.fp_quantizer.includes' is absent from the `packages` configuration.
2024-08-19T05:37:18,100   !!

2024-08-19T05:37:18,101           ********************************************************************************
2024-08-19T05:37:18,101           ############################
2024-08-19T05:37:18,102           # Package would be ignored #
2024-08-19T05:37:18,102           ############################
2024-08-19T05:37:18,103           Python recognizes 'deepspeed.ops.csrc.fp_quantizer.includes' as an importable package[^1],
2024-08-19T05:37:18,104           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,104           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,105           package, please make sure that 'deepspeed.ops.csrc.fp_quantizer.includes' is explicitly added
2024-08-19T05:37:18,105           to the `packages` configuration field.

2024-08-19T05:37:18,106           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,106           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,106           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,107           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,108           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,109           If you don't want 'deepspeed.ops.csrc.fp_quantizer.includes' to be distributed and are
2024-08-19T05:37:18,109           already explicitly excluding 'deepspeed.ops.csrc.fp_quantizer.includes' via
2024-08-19T05:37:18,110           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,110           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,110           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,111           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,112           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,113           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,113                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,114                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,114                 directory, all directories are treated like packages.
2024-08-19T05:37:18,115           ********************************************************************************

2024-08-19T05:37:18,116   !!
2024-08-19T05:37:18,116     check.warn(importable)
2024-08-19T05:37:18,117   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration.
2024-08-19T05:37:18,117   !!

2024-08-19T05:37:18,118           ********************************************************************************
2024-08-19T05:37:18,118           ############################
2024-08-19T05:37:18,119           # Package would be ignored #
2024-08-19T05:37:18,119           ############################
2024-08-19T05:37:18,120           Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1],
2024-08-19T05:37:18,120           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,121           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,121           package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added
2024-08-19T05:37:18,122           to the `packages` configuration field.

2024-08-19T05:37:18,123           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,123           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,124           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,125           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,125           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,126           If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are
2024-08-19T05:37:18,127           already explicitly excluding 'deepspeed.ops.csrc.includes' via
2024-08-19T05:37:18,128           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,128           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,128           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,129           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,130           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,131           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,131                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,132                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,132                 directory, all directories are treated like packages.
2024-08-19T05:37:18,132           ********************************************************************************

2024-08-19T05:37:18,133   !!
2024-08-19T05:37:18,134     check.warn(importable)
2024-08-19T05:37:18,134   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration.
2024-08-19T05:37:18,135   !!

2024-08-19T05:37:18,136           ********************************************************************************
2024-08-19T05:37:18,136           ############################
2024-08-19T05:37:18,137           # Package would be ignored #
2024-08-19T05:37:18,137           ############################
2024-08-19T05:37:18,138           Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1],
2024-08-19T05:37:18,138           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,139           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,140           package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added
2024-08-19T05:37:18,140           to the `packages` configuration field.

2024-08-19T05:37:18,141           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,142           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,142           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,143           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,144           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,145           If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are
2024-08-19T05:37:18,146           already explicitly excluding 'deepspeed.ops.csrc.lamb' via
2024-08-19T05:37:18,146           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,147           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,147           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,148           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,149           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,151           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,151                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,152                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,152                 directory, all directories are treated like packages.
2024-08-19T05:37:18,153           ********************************************************************************

2024-08-19T05:37:18,154   !!
2024-08-19T05:37:18,154     check.warn(importable)
2024-08-19T05:37:18,155   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration.
2024-08-19T05:37:18,156   !!

2024-08-19T05:37:18,157           ********************************************************************************
2024-08-19T05:37:18,157           ############################
2024-08-19T05:37:18,158           # Package would be ignored #
2024-08-19T05:37:18,158           ############################
2024-08-19T05:37:18,159           Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1],
2024-08-19T05:37:18,159           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,160           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,161           package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added
2024-08-19T05:37:18,161           to the `packages` configuration field.

2024-08-19T05:37:18,162           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,163           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,163           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,164           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,165           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,166           If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are
2024-08-19T05:37:18,167           already explicitly excluding 'deepspeed.ops.csrc.lion' via
2024-08-19T05:37:18,167           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,168           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,168           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,169           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,170           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,172           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,172                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,173                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,173                 directory, all directories are treated like packages.
2024-08-19T05:37:18,174           ********************************************************************************

2024-08-19T05:37:18,175   !!
2024-08-19T05:37:18,175     check.warn(importable)
2024-08-19T05:37:18,176   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration.
2024-08-19T05:37:18,176   !!

2024-08-19T05:37:18,177           ********************************************************************************
2024-08-19T05:37:18,178           ############################
2024-08-19T05:37:18,179           # Package would be ignored #
2024-08-19T05:37:18,179           ############################
2024-08-19T05:37:18,180           Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1],
2024-08-19T05:37:18,180           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,181           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,182           package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added
2024-08-19T05:37:18,182           to the `packages` configuration field.

2024-08-19T05:37:18,183           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,184           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,185           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,186           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,187           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,188           If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are
2024-08-19T05:37:18,188           already explicitly excluding 'deepspeed.ops.csrc.quantization' via
2024-08-19T05:37:18,189           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,189           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,190           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,191           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,192           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,193           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,194                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,195                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,196                 directory, all directories are treated like packages.
2024-08-19T05:37:18,197           ********************************************************************************

2024-08-19T05:37:18,199   !!
2024-08-19T05:37:18,199     check.warn(importable)
2024-08-19T05:37:18,200   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration.
2024-08-19T05:37:18,200   !!

2024-08-19T05:37:18,201           ********************************************************************************
2024-08-19T05:37:18,202           ############################
2024-08-19T05:37:18,202           # Package would be ignored #
2024-08-19T05:37:18,203           ############################
2024-08-19T05:37:18,203           Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1],
2024-08-19T05:37:18,204           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,205           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,205           package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added
2024-08-19T05:37:18,206           to the `packages` configuration field.

2024-08-19T05:37:18,207           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,207           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,208           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,209           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,210           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,211           If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are
2024-08-19T05:37:18,211           already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via
2024-08-19T05:37:18,212           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,213           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,213           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,214           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,215           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,217           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,217                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,218                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,219                 directory, all directories are treated like packages.
2024-08-19T05:37:18,219           ********************************************************************************

2024-08-19T05:37:18,220   !!
2024-08-19T05:37:18,221     check.warn(importable)
2024-08-19T05:37:18,221   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration.
2024-08-19T05:37:18,222   !!

2024-08-19T05:37:18,222           ********************************************************************************
2024-08-19T05:37:18,223           ############################
2024-08-19T05:37:18,223           # Package would be ignored #
2024-08-19T05:37:18,224           ############################
2024-08-19T05:37:18,224           Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1],
2024-08-19T05:37:18,225           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,226           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,226           package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added
2024-08-19T05:37:18,227           to the `packages` configuration field.

2024-08-19T05:37:18,228           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,228           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,229           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,230           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,231           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,232           If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are
2024-08-19T05:37:18,232           already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via
2024-08-19T05:37:18,233           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,233           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,234           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,235           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,236           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,237           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,238                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,238                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,239                 directory, all directories are treated like packages.
2024-08-19T05:37:18,239           ********************************************************************************

2024-08-19T05:37:18,241   !!
2024-08-19T05:37:18,241     check.warn(importable)
2024-08-19T05:37:18,242   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration.
2024-08-19T05:37:18,242   !!

2024-08-19T05:37:18,243           ********************************************************************************
2024-08-19T05:37:18,244           ############################
2024-08-19T05:37:18,245           # Package would be ignored #
2024-08-19T05:37:18,245           ############################
2024-08-19T05:37:18,246           Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1],
2024-08-19T05:37:18,246           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,247           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,248           package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added
2024-08-19T05:37:18,249           to the `packages` configuration field.

2024-08-19T05:37:18,249           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,250           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,251           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,251           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,252           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,253           If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are
2024-08-19T05:37:18,254           already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via
2024-08-19T05:37:18,254           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,255           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,255           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,256           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,257           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,259           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,259                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,260                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,260                 directory, all directories are treated like packages.
2024-08-19T05:37:18,261           ********************************************************************************

2024-08-19T05:37:18,262   !!
2024-08-19T05:37:18,262     check.warn(importable)
2024-08-19T05:37:18,263   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration.
2024-08-19T05:37:18,263   !!

2024-08-19T05:37:18,264           ********************************************************************************
2024-08-19T05:37:18,265           ############################
2024-08-19T05:37:18,265           # Package would be ignored #
2024-08-19T05:37:18,266           ############################
2024-08-19T05:37:18,266           Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1],
2024-08-19T05:37:18,267           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,268           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,268           package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added
2024-08-19T05:37:18,269           to the `packages` configuration field.

2024-08-19T05:37:18,270           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,271           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,271           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,272           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,273           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,274           If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are
2024-08-19T05:37:18,275           already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via
2024-08-19T05:37:18,275           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,276           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,277           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,278           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,279           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,280           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,280                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,281                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,281                 directory, all directories are treated like packages.
2024-08-19T05:37:18,282           ********************************************************************************

2024-08-19T05:37:18,283   !!
2024-08-19T05:37:18,283     check.warn(importable)
2024-08-19T05:37:18,283   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration.
2024-08-19T05:37:18,284   !!

2024-08-19T05:37:18,285           ********************************************************************************
2024-08-19T05:37:18,285           ############################
2024-08-19T05:37:18,285           # Package would be ignored #
2024-08-19T05:37:18,286           ############################
2024-08-19T05:37:18,286           Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1],
2024-08-19T05:37:18,287           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,288           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,288           package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added
2024-08-19T05:37:18,289           to the `packages` configuration field.

2024-08-19T05:37:18,290           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,290           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,291           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,292           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,293           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,294           If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are
2024-08-19T05:37:18,295           already explicitly excluding 'deepspeed.ops.csrc.transformer' via
2024-08-19T05:37:18,295           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,296           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,296           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,297           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,298           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,300           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,301                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,301                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,302                 directory, all directories are treated like packages.
2024-08-19T05:37:18,302           ********************************************************************************

2024-08-19T05:37:18,303   !!
2024-08-19T05:37:18,304     check.warn(importable)
2024-08-19T05:37:18,304   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration.
2024-08-19T05:37:18,305   !!

2024-08-19T05:37:18,306           ********************************************************************************
2024-08-19T05:37:18,307           ############################
2024-08-19T05:37:18,307           # Package would be ignored #
2024-08-19T05:37:18,308           ############################
2024-08-19T05:37:18,308           Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1],
2024-08-19T05:37:18,309           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,310           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,310           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added
2024-08-19T05:37:18,311           to the `packages` configuration field.

2024-08-19T05:37:18,311           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,312           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,313           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,313           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,314           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,316           If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are
2024-08-19T05:37:18,316           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via
2024-08-19T05:37:18,317           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,317           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,318           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,320           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,321           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,323           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,323                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,324                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,324                 directory, all directories are treated like packages.
2024-08-19T05:37:18,325           ********************************************************************************

2024-08-19T05:37:18,326   !!
2024-08-19T05:37:18,326     check.warn(importable)
2024-08-19T05:37:18,327   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration.
2024-08-19T05:37:18,327   !!

2024-08-19T05:37:18,328           ********************************************************************************
2024-08-19T05:37:18,329           ############################
2024-08-19T05:37:18,330           # Package would be ignored #
2024-08-19T05:37:18,330           ############################
2024-08-19T05:37:18,331           Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1],
2024-08-19T05:37:18,331           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,332           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,333           package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added
2024-08-19T05:37:18,334           to the `packages` configuration field.

2024-08-19T05:37:18,334           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,335           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,335           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,336           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,338           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,339           If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are
2024-08-19T05:37:18,339           already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via
2024-08-19T05:37:18,339           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,340           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,340           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,341           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,342           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,343           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,344                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,344                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,345                 directory, all directories are treated like packages.
2024-08-19T05:37:18,345           ********************************************************************************

2024-08-19T05:37:18,346   !!
2024-08-19T05:37:18,347     check.warn(importable)
2024-08-19T05:37:18,347   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration.
2024-08-19T05:37:18,348   !!

2024-08-19T05:37:18,349           ********************************************************************************
2024-08-19T05:37:18,350           ############################
2024-08-19T05:37:18,350           # Package would be ignored #
2024-08-19T05:37:18,350           ############################
2024-08-19T05:37:18,351           Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1],
2024-08-19T05:37:18,352           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,353           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,353           package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added
2024-08-19T05:37:18,354           to the `packages` configuration field.

2024-08-19T05:37:18,355           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,355           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,356           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,357           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,359           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,360           If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are
2024-08-19T05:37:18,360           already explicitly excluding 'deepspeed.ops.csrc.utils' via
2024-08-19T05:37:18,361           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,361           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,362           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,363           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,365           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,366           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,367                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,368                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,368                 directory, all directories are treated like packages.
2024-08-19T05:37:18,370           ********************************************************************************

2024-08-19T05:37:18,371   !!
2024-08-19T05:37:18,371     check.warn(importable)
2024-08-19T05:37:18,371   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adagrad' is absent from the `packages` configuration.
2024-08-19T05:37:18,372   !!

2024-08-19T05:37:18,373           ********************************************************************************
2024-08-19T05:37:18,374           ############################
2024-08-19T05:37:18,374           # Package would be ignored #
2024-08-19T05:37:18,374           ############################
2024-08-19T05:37:18,375           Python recognizes 'deepspeed.ops.csrc.xpu.adagrad' as an importable package[^1],
2024-08-19T05:37:18,375           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,377           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,377           package, please make sure that 'deepspeed.ops.csrc.xpu.adagrad' is explicitly added
2024-08-19T05:37:18,378           to the `packages` configuration field.

2024-08-19T05:37:18,379           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,379           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,380           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,381           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,382           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,383           If you don't want 'deepspeed.ops.csrc.xpu.adagrad' to be distributed and are
2024-08-19T05:37:18,384           already explicitly excluding 'deepspeed.ops.csrc.xpu.adagrad' via
2024-08-19T05:37:18,385           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,385           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,385           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,387           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,388           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,390           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,390                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,391                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,392                 directory, all directories are treated like packages.
2024-08-19T05:37:18,393           ********************************************************************************

2024-08-19T05:37:18,394   !!
2024-08-19T05:37:18,394     check.warn(importable)
2024-08-19T05:37:18,395   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.adam' is absent from the `packages` configuration.
2024-08-19T05:37:18,396   !!

2024-08-19T05:37:18,397           ********************************************************************************
2024-08-19T05:37:18,398           ############################
2024-08-19T05:37:18,398           # Package would be ignored #
2024-08-19T05:37:18,399           ############################
2024-08-19T05:37:18,399           Python recognizes 'deepspeed.ops.csrc.xpu.adam' as an importable package[^1],
2024-08-19T05:37:18,400           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,401           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,401           package, please make sure that 'deepspeed.ops.csrc.xpu.adam' is explicitly added
2024-08-19T05:37:18,402           to the `packages` configuration field.

2024-08-19T05:37:18,403           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,404           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,404           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,405           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,406           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,407           If you don't want 'deepspeed.ops.csrc.xpu.adam' to be distributed and are
2024-08-19T05:37:18,407           already explicitly excluding 'deepspeed.ops.csrc.xpu.adam' via
2024-08-19T05:37:18,407           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,408           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,408           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,409           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,410           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,411           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,412                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,412                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,413                 directory, all directories are treated like packages.
2024-08-19T05:37:18,413           ********************************************************************************

2024-08-19T05:37:18,414   !!
2024-08-19T05:37:18,415     check.warn(importable)
2024-08-19T05:37:18,415   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.common' is absent from the `packages` configuration.
2024-08-19T05:37:18,416   !!

2024-08-19T05:37:18,417           ********************************************************************************
2024-08-19T05:37:18,417           ############################
2024-08-19T05:37:18,418           # Package would be ignored #
2024-08-19T05:37:18,418           ############################
2024-08-19T05:37:18,419           Python recognizes 'deepspeed.ops.csrc.xpu.common' as an importable package[^1],
2024-08-19T05:37:18,419           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,420           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,421           package, please make sure that 'deepspeed.ops.csrc.xpu.common' is explicitly added
2024-08-19T05:37:18,421           to the `packages` configuration field.

2024-08-19T05:37:18,422           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,423           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,423           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,425           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,425           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,426           If you don't want 'deepspeed.ops.csrc.xpu.common' to be distributed and are
2024-08-19T05:37:18,427           already explicitly excluding 'deepspeed.ops.csrc.xpu.common' via
2024-08-19T05:37:18,427           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,428           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,429           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,430           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,431           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,432           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,433                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,433                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,434                 directory, all directories are treated like packages.
2024-08-19T05:37:18,434           ********************************************************************************

2024-08-19T05:37:18,435   !!
2024-08-19T05:37:18,435     check.warn(importable)
2024-08-19T05:37:18,436   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.includes' is absent from the `packages` configuration.
2024-08-19T05:37:18,436   !!

2024-08-19T05:37:18,437           ********************************************************************************
2024-08-19T05:37:18,438           ############################
2024-08-19T05:37:18,438           # Package would be ignored #
2024-08-19T05:37:18,439           ############################
2024-08-19T05:37:18,439           Python recognizes 'deepspeed.ops.csrc.xpu.includes' as an importable package[^1],
2024-08-19T05:37:18,440           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,441           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,441           package, please make sure that 'deepspeed.ops.csrc.xpu.includes' is explicitly added
2024-08-19T05:37:18,442           to the `packages` configuration field.

2024-08-19T05:37:18,443           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,443           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,443           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,444           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,445           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,446           If you don't want 'deepspeed.ops.csrc.xpu.includes' to be distributed and are
2024-08-19T05:37:18,447           already explicitly excluding 'deepspeed.ops.csrc.xpu.includes' via
2024-08-19T05:37:18,447           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,447           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,448           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,449           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,450           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,451           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,452                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,452                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,453                 directory, all directories are treated like packages.
2024-08-19T05:37:18,453           ********************************************************************************

2024-08-19T05:37:18,454   !!
2024-08-19T05:37:18,455     check.warn(importable)
2024-08-19T05:37:18,456   /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:215: _Warning: Package 'deepspeed.ops.csrc.xpu.packbits' is absent from the `packages` configuration.
2024-08-19T05:37:18,456   !!

2024-08-19T05:37:18,457           ********************************************************************************
2024-08-19T05:37:18,458           ############################
2024-08-19T05:37:18,458           # Package would be ignored #
2024-08-19T05:37:18,459           ############################
2024-08-19T05:37:18,460           Python recognizes 'deepspeed.ops.csrc.xpu.packbits' as an importable package[^1],
2024-08-19T05:37:18,460           but it is absent from setuptools' `packages` configuration.

2024-08-19T05:37:18,462           This leads to an ambiguous overall configuration. If you want to distribute this
2024-08-19T05:37:18,462           package, please make sure that 'deepspeed.ops.csrc.xpu.packbits' is explicitly added
2024-08-19T05:37:18,462           to the `packages` configuration field.

2024-08-19T05:37:18,463           Alternatively, you can also rely on setuptools' discovery methods
2024-08-19T05:37:18,464           (for example by using `find_namespace_packages(...)`/`find_namespace:`
2024-08-19T05:37:18,464           instead of `find_packages(...)`/`find:`).

2024-08-19T05:37:18,465           You can read more about "package discovery" on setuptools documentation page:

2024-08-19T05:37:18,466           - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html

2024-08-19T05:37:18,467           If you don't want 'deepspeed.ops.csrc.xpu.packbits' to be distributed and are
2024-08-19T05:37:18,468           already explicitly excluding 'deepspeed.ops.csrc.xpu.packbits' via
2024-08-19T05:37:18,468           `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`,
2024-08-19T05:37:18,469           you can try to use `exclude_package_data`, or `include-package-data=False` in
2024-08-19T05:37:18,469           combination with a more fine grained `package-data` configuration.

2024-08-19T05:37:18,470           You can read more about "package data files" on setuptools documentation page:

2024-08-19T05:37:18,471           - https://setuptools.pypa.io/en/latest/userguide/datafiles.html


2024-08-19T05:37:18,473           [^1]: For Python, any directory (with suitable naming) can be imported,
2024-08-19T05:37:18,473                 even if it does not contain any `.py` files.
2024-08-19T05:37:18,474                 On the other hand, currently there is no concept of package data
2024-08-19T05:37:18,474                 directory, all directories are treated like packages.
2024-08-19T05:37:18,474           ********************************************************************************

2024-08-19T05:37:18,475   !!
2024-08-19T05:37:18,476     check.warn(importable)
2024-08-19T05:37:18,476   creating build/lib/deepspeed/autotuning/config_templates
2024-08-19T05:37:18,477   copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates
2024-08-19T05:37:18,477   copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates
2024-08-19T05:37:18,478   copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates
2024-08-19T05:37:18,478   copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates
2024-08-19T05:37:18,479   creating build/lib/deepspeed/ops/csrc
2024-08-19T05:37:18,479   creating build/lib/deepspeed/ops/csrc/adagrad
2024-08-19T05:37:18,480   copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad
2024-08-19T05:37:18,481   creating build/lib/deepspeed/ops/csrc/adam
2024-08-19T05:37:18,481   copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-08-19T05:37:18,481   copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-08-19T05:37:18,482   copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam
2024-08-19T05:37:18,483   copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam
2024-08-19T05:37:18,483   copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam
2024-08-19T05:37:18,483   creating build/lib/deepspeed/ops/csrc/aio
2024-08-19T05:37:18,484   creating build/lib/deepspeed/ops/csrc/aio/common
2024-08-19T05:37:18,484   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-19T05:37:18,485   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-19T05:37:18,486   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-19T05:37:18,486   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-19T05:37:18,486   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-19T05:37:18,487   copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common
2024-08-19T05:37:18,487   creating build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,488   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,488   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,489   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,490   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,490   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,490   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,491   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,491   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,492   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,492   copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,493   copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:18,493   creating build/lib/deepspeed/ops/csrc/aio/py_test
2024-08-19T05:37:18,494   copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test
2024-08-19T05:37:18,494   creating build/lib/deepspeed/ops/csrc/cpu
2024-08-19T05:37:18,495   creating build/lib/deepspeed/ops/csrc/cpu/adam
2024-08-19T05:37:18,495   copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam
2024-08-19T05:37:18,495   creating build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:18,496   copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:18,496   copying deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:18,497   copying deepspeed/ops/csrc/cpu/comm/shm.h -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:18,498   copying deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:18,498   creating build/lib/deepspeed/ops/csrc/cpu/lion
2024-08-19T05:37:18,499   copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion
2024-08-19T05:37:18,499   creating build/lib/deepspeed/ops/csrc/deepspeed4science
2024-08-19T05:37:18,500   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:18,500   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:18,501   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:18,501   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:18,502   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:18,502   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:18,503   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:18,503   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:18,504   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:18,504   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:18,505   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:18,505   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:18,506   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:18,506   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:18,507   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:18,507   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:18,508   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:18,508   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:18,509   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:18,509   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:18,510   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:18,510   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:18,511   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:18,511   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:18,512   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:18,512   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:18,513   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:18,513   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:18,514   creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-19T05:37:18,514   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-19T05:37:18,515   copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-19T05:37:18,515   creating build/lib/deepspeed/ops/csrc/fp_quantizer
2024-08-19T05:37:18,516   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-08-19T05:37:18,516   copying deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/lib/deepspeed/ops/csrc/fp_quantizer
2024-08-19T05:37:18,517   creating build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-08-19T05:37:18,517   copying deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-08-19T05:37:18,518   copying deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/lib/deepspeed/ops/csrc/fp_quantizer/includes
2024-08-19T05:37:18,518   creating build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,518   copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,519   copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,519   copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,520   copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,520   copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,521   copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,522   copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,522   copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,523   copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,523   copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,524   copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,524   copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,525   copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,525   copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,526   copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,526   copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,527   copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,527   copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,528   copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,528   copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,529   copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,529   copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,530   copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,530   copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,531   copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,531   copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,532   copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,532   copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,533   copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes
2024-08-19T05:37:18,533   creating build/lib/deepspeed/ops/csrc/lamb
2024-08-19T05:37:18,534   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb
2024-08-19T05:37:18,534   copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb
2024-08-19T05:37:18,534   creating build/lib/deepspeed/ops/csrc/lion
2024-08-19T05:37:18,535   copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-08-19T05:37:18,535   copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-08-19T05:37:18,536   copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion
2024-08-19T05:37:18,536   copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion
2024-08-19T05:37:18,537   copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion
2024-08-19T05:37:18,537   creating build/lib/deepspeed/ops/csrc/quantization
2024-08-19T05:37:18,538   copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-19T05:37:18,538   copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-19T05:37:18,539   copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization
2024-08-19T05:37:18,539   copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-19T05:37:18,540   copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-19T05:37:18,540   copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-19T05:37:18,541   copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization
2024-08-19T05:37:18,541   creating build/lib/deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:18,542   copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:18,542   copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:18,543   copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:18,545   copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:18,548   creating build/lib/deepspeed/ops/csrc/sparse_attention
2024-08-19T05:37:18,549   copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention
2024-08-19T05:37:18,551   creating build/lib/deepspeed/ops/csrc/spatial
2024-08-19T05:37:18,552   creating build/lib/deepspeed/ops/csrc/spatial/csrc
2024-08-19T05:37:18,553   copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-08-19T05:37:18,555   copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc
2024-08-19T05:37:18,557   creating build/lib/deepspeed/ops/csrc/spatial/includes
2024-08-19T05:37:18,558   copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes
2024-08-19T05:37:18,561   creating build/lib/deepspeed/ops/csrc/transformer
2024-08-19T05:37:18,562   copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-19T05:37:18,565   copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-19T05:37:18,568   copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer
2024-08-19T05:37:18,572   copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-19T05:37:18,574   copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-19T05:37:18,577   copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-19T05:37:18,581   copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-19T05:37:18,583   copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer
2024-08-19T05:37:18,586   creating build/lib/deepspeed/ops/csrc/transformer/inference
2024-08-19T05:37:18,587   creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,588   copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,591   copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,593   copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,596   copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,599   copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,601   copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,606   copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,608   copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,610   copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,613   copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:18,616   creating build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-08-19T05:37:18,617   copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-08-19T05:37:18,620   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-08-19T05:37:18,623   copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes
2024-08-19T05:37:18,625   creating build/lib/deepspeed/ops/csrc/utils
2024-08-19T05:37:18,626   copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils
2024-08-19T05:37:18,629   creating build/lib/deepspeed/ops/csrc/xpu
2024-08-19T05:37:18,629   creating build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-08-19T05:37:18,630   copying deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/xpu/adagrad
2024-08-19T05:37:18,633   creating build/lib/deepspeed/ops/csrc/xpu/adam
2024-08-19T05:37:18,634   copying deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-08-19T05:37:18,636   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-08-19T05:37:18,639   copying deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/lib/deepspeed/ops/csrc/xpu/adam
2024-08-19T05:37:18,642   creating build/lib/deepspeed/ops/csrc/xpu/common
2024-08-19T05:37:18,643   copying deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/lib/deepspeed/ops/csrc/xpu/common
2024-08-19T05:37:18,645   creating build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:18,646   copying deepspeed/ops/csrc/xpu/includes/compat.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:18,648   copying deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:18,650   copying deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:18,653   copying deepspeed/ops/csrc/xpu/includes/simd.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:18,655   copying deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:18,657   creating build/lib/deepspeed/ops/csrc/xpu/packbits
2024-08-19T05:37:18,658   copying deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/lib/deepspeed/ops/csrc/xpu/packbits
2024-08-19T05:37:18,661   creating build/lib/deepspeed/inference/v2/ragged/csrc
2024-08-19T05:37:18,662   copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-08-19T05:37:18,664   copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc
2024-08-19T05:37:18,666   creating build/lib/deepspeed/inference/v2/ragged/includes
2024-08-19T05:37:18,667   copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes
2024-08-19T05:37:18,669   creating build/lib/deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:18,670   copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:18,672   copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:18,675   copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:18,677   copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:18,680   copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:18,683   copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops
2024-08-19T05:37:18,685   creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-08-19T05:37:18,686   copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-08-19T05:37:18,689   copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops
2024-08-19T05:37:18,691   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops
2024-08-19T05:37:18,693   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-08-19T05:37:18,694   copying deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-08-19T05:37:18,696   creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-19T05:37:18,697   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-19T05:37:18,699   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-19T05:37:18,701   copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-19T05:37:18,703   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:18,706   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:18,708   copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:18,710   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:18,712   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:18,714   copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:18,716   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:18,718   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:18,720   copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:18,723   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:18,725   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:18,727   copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:18,730   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:18,732   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:18,734   copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:18,737   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:18,739   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:18,741   copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:18,744   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:18,746   copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:18,749   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:18,751   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:18,758   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:18,760   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:18,762   creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,763   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,766   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,769   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,771   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,774   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,777   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,779   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,787   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,789   copying deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:18,792   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:18,794   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:18,796   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:18,798   copying deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:18,801   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:18,803   copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:18,805   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:18,807   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:18,810   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:18,812   copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:18,814   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:18,817   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:18,819   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:18,821   copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:18,824   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:18,826   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:18,829   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:18,831   copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:18,833   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:18,836   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:18,838   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:18,840   copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:18,843   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:18,845   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:18,847   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:18,850   copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:18,853   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:18,855   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:18,858   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:18,860   copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:18,863   copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:18,866   copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:18,868   copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:18,919   running build_scripts
2024-08-19T05:37:18,920   creating build/scripts-3.11
2024-08-19T05:37:18,921   copying and adjusting bin/deepspeed -> build/scripts-3.11
2024-08-19T05:37:18,923   copying and adjusting bin/deepspeed.pt -> build/scripts-3.11
2024-08-19T05:37:18,924   copying and adjusting bin/ds -> build/scripts-3.11
2024-08-19T05:37:18,926   copying bin/ds_ssh -> build/scripts-3.11
2024-08-19T05:37:18,928   copying and adjusting bin/ds_report -> build/scripts-3.11
2024-08-19T05:37:18,930   copying and adjusting bin/ds_bench -> build/scripts-3.11
2024-08-19T05:37:18,931   copying and adjusting bin/dsr -> build/scripts-3.11
2024-08-19T05:37:18,933   copying and adjusting bin/ds_elastic -> build/scripts-3.11
2024-08-19T05:37:18,934   changing mode of build/scripts-3.11/deepspeed from 644 to 755
2024-08-19T05:37:18,934   changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755
2024-08-19T05:37:18,935   changing mode of build/scripts-3.11/ds from 644 to 755
2024-08-19T05:37:18,935   changing mode of build/scripts-3.11/ds_report from 644 to 755
2024-08-19T05:37:18,935   changing mode of build/scripts-3.11/ds_bench from 644 to 755
2024-08-19T05:37:18,936   changing mode of build/scripts-3.11/dsr from 644 to 755
2024-08-19T05:37:18,936   changing mode of build/scripts-3.11/ds_elastic from 644 to 755
2024-08-19T05:37:18,963   /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
2024-08-19T05:37:18,964   !!

2024-08-19T05:37:18,965           ********************************************************************************
2024-08-19T05:37:18,965           Please avoid running ``setup.py`` directly.
2024-08-19T05:37:18,966           Instead, use pypa/build, pypa/installer or other
2024-08-19T05:37:18,966           standards-based tools.

2024-08-19T05:37:18,967           See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
2024-08-19T05:37:18,968           ********************************************************************************

2024-08-19T05:37:18,969   !!
2024-08-19T05:37:18,969     self.initialize_options()
2024-08-19T05:37:18,991   installing to build/bdist.linux-armv7l/wheel
2024-08-19T05:37:18,991   running install
2024-08-19T05:37:19,017   running install_lib
2024-08-19T05:37:19,043   creating build/bdist.linux-armv7l
2024-08-19T05:37:19,044   creating build/bdist.linux-armv7l/wheel
2024-08-19T05:37:19,046   creating build/bdist.linux-armv7l/wheel/deepspeed
2024-08-19T05:37:19,048   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning
2024-08-19T05:37:19,049   copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-19T05:37:19,051   copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-19T05:37:19,054   copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-19T05:37:19,057   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates
2024-08-19T05:37:19,058   copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-08-19T05:37:19,060   copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-08-19T05:37:19,061   copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-08-19T05:37:19,063   copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/config_templates
2024-08-19T05:37:19,065   copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-19T05:37:19,067   creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner
2024-08-19T05:37:19,068   copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-19T05:37:19,070   copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-19T05:37:19,072   copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-19T05:37:19,074   copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-19T05:37:19,076   copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-19T05:37:19,078   copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning/tuner
2024-08-19T05:37:19,080   copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-19T05:37:19,083   copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/autotuning
2024-08-19T05:37:19,086   creating build/bdist.linux-armv7l/wheel/deepspeed/moe
2024-08-19T05:37:19,087   copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-19T05:37:19,089   copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-19T05:37:19,091   copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-19T05:37:19,093   copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-19T05:37:19,095   copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-19T05:37:19,097   copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/moe
2024-08-19T05:37:19,100   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations
2024-08-19T05:37:19,101   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers
2024-08-19T05:37:19,102   copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,104   copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,106   copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,108   copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,110   copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,112   copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,114   copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,116   copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,118   copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,120   copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/transformers
2024-08-19T05:37:19,122   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features
2024-08-19T05:37:19,123   copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-08-19T05:37:19,125   copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/features
2024-08-19T05:37:19,127   creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers
2024-08-19T05:37:19,128   copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-08-19T05:37:19,130   copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-08-19T05:37:19,132   copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations/diffusers
2024-08-19T05:37:19,134   copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/model_implementations
2024-08-19T05:37:19,136   copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-19T05:37:19,139   creating build/bdist.linux-armv7l/wheel/deepspeed/utils
2024-08-19T05:37:19,140   copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,142   copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,144   copying build/lib/deepspeed/utils/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,146   copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,148   copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,150   copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,152   copying build/lib/deepspeed/utils/z3_leaf_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,154   copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,156   copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,158   copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,160   copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,163   copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,165   copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,167   copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,169   copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,171   copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,173   copying build/lib/deepspeed/utils/bwc.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,175   copying build/lib/deepspeed/utils/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/utils
2024-08-19T05:37:19,177   copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-19T05:37:19,179   creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint
2024-08-19T05:37:19,180   copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,182   copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,185   copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,187   copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,190   copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,193   copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,195   copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,197   copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,199   copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,202   copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/./deepspeed/checkpoint
2024-08-19T05:37:19,204   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime
2024-08-19T05:37:19,205   copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,208   copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,211   copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,213   copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,215   copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,218   copying build/lib/deepspeed/runtime/compiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,220   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing
2024-08-19T05:37:19,221   copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-08-19T05:37:19,223   copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-08-19T05:37:19,226   copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/activation_checkpointing
2024-08-19T05:37:19,228   copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,231   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline
2024-08-19T05:37:19,231   copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-08-19T05:37:19,234   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:19,235   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:19,237   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:19,239   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:19,241   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:19,243   copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_routing
2024-08-19T05:37:19,246   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:19,247   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:19,249   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:19,252   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:19,254   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:19,256   copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline/data_sampling
2024-08-19T05:37:19,259   copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-08-19T05:37:19,260   copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-08-19T05:37:19,263   copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/data_pipeline
2024-08-19T05:37:19,265   copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,266   copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,269   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm
2024-08-19T05:37:19,270   copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-19T05:37:19,272   copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-19T05:37:19,274   copying build/lib/deepspeed/runtime/comm/compressed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-19T05:37:19,277   copying build/lib/deepspeed/runtime/comm/hccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-19T05:37:19,279   copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-19T05:37:19,281   copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/comm
2024-08-19T05:37:19,283   copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,286   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression
2024-08-19T05:37:19,288   copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-08-19T05:37:19,290   copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/compression
2024-08-19T05:37:19,292   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16
2024-08-19T05:37:19,294   copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-08-19T05:37:19,297   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit
2024-08-19T05:37:19,298   copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-08-19T05:37:19,301   copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-08-19T05:37:19,303   copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-08-19T05:37:19,306   copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16/onebit
2024-08-19T05:37:19,309   copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-08-19T05:37:19,312   copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-08-19T05:37:19,315   copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/fp16
2024-08-19T05:37:19,318   copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,320   copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,326   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero
2024-08-19T05:37:19,327   copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,330   copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,332   copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,337   copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,339   copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,341   copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,346   copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,350   copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,352   copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,354   copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,357   copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,359   copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,362   copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,365   copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,368   copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,371   copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/zero
2024-08-19T05:37:19,374   copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,377   copying build/lib/deepspeed/runtime/base_optimizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,379   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe
2024-08-19T05:37:19,381   copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-19T05:37:19,383   copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-19T05:37:19,386   copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-19T05:37:19,388   copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-19T05:37:19,392   copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-19T05:37:19,395   copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/pipe
2024-08-19T05:37:19,398   copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,401   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:19,402   copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:19,405   copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:19,407   copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:19,409   copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/checkpoint_engine
2024-08-19T05:37:19,412   creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,414   copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,416   copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,419   copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,421   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,423   copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,426   copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,429   copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,430   copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,433   copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime/swap_tensor
2024-08-19T05:37:19,436   copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,439   copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,442   copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/runtime
2024-08-19T05:37:19,446   creating build/bdist.linux-armv7l/wheel/deepspeed/comm
2024-08-19T05:37:19,447   copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-19T05:37:19,450   copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-19T05:37:19,453   copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-19T05:37:19,455   copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-19T05:37:19,460   copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-19T05:37:19,463   copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-19T05:37:19,466   copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-19T05:37:19,469   copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-19T05:37:19,471   copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/./deepspeed/comm
2024-08-19T05:37:19,474   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject
2024-08-19T05:37:19,475   copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,477   copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,479   copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,481   copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,483   copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,485   copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,488   copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,490   copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,492   copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,494   copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,496   copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,499   copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,501   copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject
2024-08-19T05:37:19,504   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers
2024-08-19T05:37:19,505   copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,507   copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,509   copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,512   copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,513   copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,516   creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features
2024-08-19T05:37:19,517   copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-19T05:37:19,519   copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-19T05:37:19,522   copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-19T05:37:19,524   copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-19T05:37:19,526   copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-19T05:37:19,528   copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-19T05:37:19,531   copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers/features
2024-08-19T05:37:19,533   copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,535   copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,538   copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,540   copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,542   copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,544   copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,546   copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,548   copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,550   copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,552   copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,554   copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,557   copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,559   copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,562   copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/./deepspeed/module_inject/containers
2024-08-19T05:37:19,565   creating build/bdist.linux-armv7l/wheel/deepspeed/compression
2024-08-19T05:37:19,565   copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-19T05:37:19,568   copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-19T05:37:19,570   copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-19T05:37:19,572   copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-19T05:37:19,575   copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-19T05:37:19,577   copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-19T05:37:19,579   copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-19T05:37:19,582   copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/compression
2024-08-19T05:37:19,585   creating build/bdist.linux-armv7l/wheel/deepspeed/monitor
2024-08-19T05:37:19,586   copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-19T05:37:19,589   copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-19T05:37:19,591   copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-19T05:37:19,593   copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-19T05:37:19,595   copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-19T05:37:19,596   copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-19T05:37:19,598   copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-19T05:37:19,601   copying build/lib/deepspeed/monitor/comet.py -> build/bdist.linux-armv7l/wheel/./deepspeed/monitor
2024-08-19T05:37:19,603   creating build/bdist.linux-armv7l/wheel/deepspeed/sequence
2024-08-19T05:37:19,604   copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-08-19T05:37:19,606   copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/sequence
2024-08-19T05:37:19,608   copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-19T05:37:19,611   creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator
2024-08-19T05:37:19,612   copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-19T05:37:19,614   copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-19T05:37:19,617   copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-19T05:37:19,619   copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-19T05:37:19,621   copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-19T05:37:19,623   copying build/lib/deepspeed/accelerator/xpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-19T05:37:19,625   copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-19T05:37:19,628   copying build/lib/deepspeed/accelerator/hpu_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-19T05:37:19,630   copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/accelerator
2024-08-19T05:37:19,633   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling
2024-08-19T05:37:19,634   copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-08-19T05:37:19,636   copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-08-19T05:37:19,638   creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler
2024-08-19T05:37:19,639   copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-08-19T05:37:19,643   copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling/flops_profiler
2024-08-19T05:37:19,645   copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/profiling
2024-08-19T05:37:19,647   creating build/bdist.linux-armv7l/wheel/deepspeed/pipe
2024-08-19T05:37:19,648   copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/pipe
2024-08-19T05:37:19,650   creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity
2024-08-19T05:37:19,651   copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-19T05:37:19,654   copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-19T05:37:19,655   copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-19T05:37:19,658   copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-19T05:37:19,661   copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-19T05:37:19,663   copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/elasticity
2024-08-19T05:37:19,665   copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-19T05:37:19,667   copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-19T05:37:19,669   creating build/bdist.linux-armv7l/wheel/deepspeed/inference
2024-08-19T05:37:19,671   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization
2024-08-19T05:37:19,672   copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-19T05:37:19,674   copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-19T05:37:19,676   copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-19T05:37:19,678   copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-19T05:37:19,680   copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/quantization
2024-08-19T05:37:19,682   copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-08-19T05:37:19,683   copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-08-19T05:37:19,686   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2
2024-08-19T05:37:19,688   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations
2024-08-19T05:37:19,689   copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-19T05:37:19,692   copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-19T05:37:19,695   copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-19T05:37:19,697   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:19,698   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:19,700   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:19,702   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:19,704   copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mistral
2024-08-19T05:37:19,706   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,707   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,710   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,712   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,714   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,716   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,718   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,720   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,723   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,725   copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/sharding
2024-08-19T05:37:19,727   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:19,728   copying build/lib/deepspeed/inference/v2/model_implementations/phi/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:19,730   copying build/lib/deepspeed/inference/v2/model_implementations/phi/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:19,731   copying build/lib/deepspeed/inference/v2/model_implementations/phi/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:19,733   copying build/lib/deepspeed/inference/v2/model_implementations/phi/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi
2024-08-19T05:37:19,735   copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-19T05:37:19,737   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:19,738   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:19,744   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:19,746   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:19,748   copying build/lib/deepspeed/inference/v2/model_implementations/qwen/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen
2024-08-19T05:37:19,751   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:19,752   copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:19,754   copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:19,755   copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:19,757   copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/opt
2024-08-19T05:37:19,759   copying build/lib/deepspeed/inference/v2/model_implementations/flat_model_helpers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-19T05:37:19,762   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:19,763   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:19,765   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:19,767   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:19,769   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2_moe
2024-08-19T05:37:19,771   copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-19T05:37:19,774   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:19,775   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:19,777   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:19,779   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:19,781   copying build/lib/deepspeed/inference/v2/model_implementations/phi3/containers.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/phi3
2024-08-19T05:37:19,783   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:19,784   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:19,786   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:19,788   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:19,789   copying build/lib/deepspeed/inference/v2/model_implementations/mixtral/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/mixtral
2024-08-19T05:37:19,791   copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations
2024-08-19T05:37:19,794   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:19,795   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:19,797   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:19,799   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:19,801   copying build/lib/deepspeed/inference/v2/model_implementations/falcon/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/falcon
2024-08-19T05:37:19,804   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:19,805   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:19,807   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:19,808   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:19,810   copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/llama_v2
2024-08-19T05:37:19,813   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:19,814   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/policy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:19,816   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:19,818   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/container.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:19,819   copying build/lib/deepspeed/inference/v2/model_implementations/qwen_v2/model.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/qwen_v2
2024-08-19T05:37:19,822   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,823   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,825   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,827   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,829   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,831   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,834   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,836   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,839   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,841   copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/model_implementations/common_parameters
2024-08-19T05:37:19,844   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint
2024-08-19T05:37:19,845   copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-08-19T05:37:19,848   copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-08-19T05:37:19,851   copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-08-19T05:37:19,853   copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/checkpoint
2024-08-19T05:37:19,856   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged
2024-08-19T05:37:19,857   copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-19T05:37:19,861   copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-19T05:37:19,863   copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-19T05:37:19,866   copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-19T05:37:19,869   copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-19T05:37:19,871   copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-19T05:37:19,874   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc
2024-08-19T05:37:19,876   copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-08-19T05:37:19,878   copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/csrc
2024-08-19T05:37:19,881   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes
2024-08-19T05:37:19,882   copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged/includes
2024-08-19T05:37:19,885   copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/ragged
2024-08-19T05:37:19,888   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels
2024-08-19T05:37:19,889   copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-08-19T05:37:19,892   copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels
2024-08-19T05:37:19,895   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops
2024-08-19T05:37:19,896   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-08-19T05:37:19,899   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops
2024-08-19T05:37:19,902   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:19,903   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:19,906   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:19,909   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:19,911   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:19,914   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm
2024-08-19T05:37:19,916   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-08-19T05:37:19,918   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/shared_resources
2024-08-19T05:37:19,921   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:19,922   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:19,925   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:19,927   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:19,929   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:19,931   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:19,934   copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm
2024-08-19T05:37:19,936   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:19,937   copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:19,940   copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:19,942   copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:19,944   copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:19,947   copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/includes
2024-08-19T05:37:19,949   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops
2024-08-19T05:37:19,950   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:19,951   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:19,953   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:19,955   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:19,958   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:19,959   copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/gated_activations
2024-08-19T05:37:19,962   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:19,963   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:19,965   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:19,967   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:19,969   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:19,971   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:19,972   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:19,974   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm
2024-08-19T05:37:19,976   copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-08-19T05:37:19,978   copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops
2024-08-19T05:37:19,980   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:19,981   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:19,983   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:19,985   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:19,988   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:19,990   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:19,992   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:19,994   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:19,996   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm
2024-08-19T05:37:19,999   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:20,000   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:20,001   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:20,004   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:20,006   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:20,007   copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/bias_activations
2024-08-19T05:37:20,010   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:20,011   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:20,013   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:20,015   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:20,017   copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/blas_kernels
2024-08-19T05:37:20,020   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:20,020   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:20,023   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,024   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,026   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,029   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,031   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,033   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,035   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,038   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,040   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,041   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear/include
2024-08-19T05:37:20,044   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:20,046   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:20,048   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:20,050   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:20,052   copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/core_ops/cuda_linear
2024-08-19T05:37:20,054   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops
2024-08-19T05:37:20,056   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:20,057   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:20,059   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:20,061   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:20,064   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:20,066   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:20,067   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/top_k_gating
2024-08-19T05:37:20,070   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:20,071   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:20,073   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:20,075   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:20,076   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/atom_builder
2024-08-19T05:37:20,078   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-08-19T05:37:20,081   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:20,082   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:20,083   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:20,085   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:20,087   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:20,089   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:20,091   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/blocked_flash
2024-08-19T05:37:20,093   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:20,094   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:20,096   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:20,098   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:20,099   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:20,101   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:20,103   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_gather
2024-08-19T05:37:20,106   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-19T05:37:20,107   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-19T05:37:20,108   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-19T05:37:20,110   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers
2024-08-19T05:37:20,113   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/includes
2024-08-19T05:37:20,114   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/includes
2024-08-19T05:37:20,116   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:20,117   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:20,119   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:20,121   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:20,123   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:20,125   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:20,127   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/embed
2024-08-19T05:37:20,130   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:20,130   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:20,132   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:20,134   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:20,136   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:20,138   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:20,140   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:20,143   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:20,145   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary
2024-08-19T05:37:20,147   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops
2024-08-19T05:37:20,149   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:20,150   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:20,152   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:20,154   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:20,156   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:20,158   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:20,160   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/moe_scatter
2024-08-19T05:37:20,162   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:20,163   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:20,165   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:20,167   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:20,169   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:20,171   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:20,172   copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/kernels/ragged_ops/logits_gather
2024-08-19T05:37:20,174   copying build/lib/deepspeed/inference/v2/inference_parameter.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-19T05:37:20,176   copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-19T05:37:20,178   copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-19T05:37:20,180   copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-19T05:37:20,182   copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-19T05:37:20,184   copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-19T05:37:20,186   copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-19T05:37:20,188   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules
2024-08-19T05:37:20,189   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:20,190   copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:20,193   copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:20,194   copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:20,197   copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:20,198   copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:20,200   copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:20,202   copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:20,205   copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/interfaces
2024-08-19T05:37:20,207   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations
2024-08-19T05:37:20,208   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe
2024-08-19T05:37:20,209   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-08-19T05:37:20,212   copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/moe
2024-08-19T05:37:20,214   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed
2024-08-19T05:37:20,215   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-08-19T05:37:20,217   copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/unembed
2024-08-19T05:37:20,220   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm
2024-08-19T05:37:20,221   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-08-19T05:37:20,223   copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/post_norm
2024-08-19T05:37:20,225   copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations
2024-08-19T05:37:20,227   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-19T05:37:20,228   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-19T05:37:20,230   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-19T05:37:20,232   copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/pre_norm
2024-08-19T05:37:20,234   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding
2024-08-19T05:37:20,235   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-08-19T05:37:20,237   copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/embedding
2024-08-19T05:37:20,239   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear
2024-08-19T05:37:20,240   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-08-19T05:37:20,242   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-08-19T05:37:20,244   copying build/lib/deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/linear
2024-08-19T05:37:20,247   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention
2024-08-19T05:37:20,248   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-08-19T05:37:20,250   copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/implementations/attention
2024-08-19T05:37:20,252   copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-08-19T05:37:20,254   copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-08-19T05:37:20,256   copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-08-19T05:37:20,259   creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs
2024-08-19T05:37:20,259   copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-19T05:37:20,261   copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-19T05:37:20,263   copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-19T05:37:20,265   copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-19T05:37:20,267   copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-19T05:37:20,268   copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-19T05:37:20,270   copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules/configs
2024-08-19T05:37:20,272   copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2/modules
2024-08-19T05:37:20,274   copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-19T05:37:20,276   copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference/v2
2024-08-19T05:37:20,278   copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/inference
2024-08-19T05:37:20,281   creating build/bdist.linux-armv7l/wheel/deepspeed/nebula
2024-08-19T05:37:20,282   copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-08-19T05:37:20,284   copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-08-19T05:37:20,286   copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/nebula
2024-08-19T05:37:20,288   creating build/bdist.linux-armv7l/wheel/deepspeed/linear
2024-08-19T05:37:20,289   copying build/lib/deepspeed/linear/optimized_linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-19T05:37:20,291   copying build/lib/deepspeed/linear/quantization.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-19T05:37:20,294   copying build/lib/deepspeed/linear/context_manager.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-19T05:37:20,295   copying build/lib/deepspeed/linear/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-19T05:37:20,297   copying build/lib/deepspeed/linear/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/linear
2024-08-19T05:37:20,300   creating build/bdist.linux-armv7l/wheel/deepspeed/launcher
2024-08-19T05:37:20,300   copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-19T05:37:20,303   copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-19T05:37:20,305   copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-19T05:37:20,308   copying build/lib/deepspeed/launcher/launcher_helper.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-19T05:37:20,310   copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-19T05:37:20,312   copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/launcher
2024-08-19T05:37:20,314   creating build/bdist.linux-armv7l/wheel/deepspeed/ops
2024-08-19T05:37:20,316   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd
2024-08-19T05:37:20,317   copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-08-19T05:37:20,318   copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/random_ltd
2024-08-19T05:37:20,321   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/fp_quantizer
2024-08-19T05:37:20,322   copying build/lib/deepspeed/ops/fp_quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-08-19T05:37:20,323   copying build/lib/deepspeed/ops/fp_quantizer/quantize.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-08-19T05:37:20,326   copying build/lib/deepspeed/ops/fp_quantizer/fp8_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/fp_quantizer
2024-08-19T05:37:20,329   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion
2024-08-19T05:37:20,329   copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-08-19T05:37:20,331   copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-08-19T05:37:20,333   copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-08-19T05:37:20,335   copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lion
2024-08-19T05:37:20,338   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam
2024-08-19T05:37:20,339   copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-08-19T05:37:20,341   copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-08-19T05:37:20,343   copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-08-19T05:37:20,345   copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adam
2024-08-19T05:37:20,348   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention
2024-08-19T05:37:20,349   copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-19T05:37:20,352   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:20,353   copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:20,355   copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:20,357   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:20,359   copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention/trsrc
2024-08-19T05:37:20,361   copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-19T05:37:20,363   copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-19T05:37:20,366   copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-19T05:37:20,368   copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-19T05:37:20,370   copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-19T05:37:20,372   copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/sparse_attention
2024-08-19T05:37:20,375   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad
2024-08-19T05:37:20,376   copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-08-19T05:37:20,378   copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/adagrad
2024-08-19T05:37:20,380   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer
2024-08-19T05:37:20,381   copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-08-19T05:37:20,383   copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/quantizer
2024-08-19T05:37:20,385   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb
2024-08-19T05:37:20,386   copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-08-19T05:37:20,388   copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/lamb
2024-08-19T05:37:20,390   copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops
2024-08-19T05:37:20,392   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio
2024-08-19T05:37:20,393   copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/aio
2024-08-19T05:37:20,395   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc
2024-08-19T05:37:20,397   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:20,398   copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:20,400   copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:20,403   copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:20,405   copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/random_ltd
2024-08-19T05:37:20,407   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer
2024-08-19T05:37:20,408   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-08-19T05:37:20,411   copying build/lib/deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer
2024-08-19T05:37:20,414   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/fp_quantizer/includes
2024-08-19T05:37:20,415   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-08-19T05:37:20,417   copying build/lib/deepspeed/ops/csrc/fp_quantizer/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/fp_quantizer/includes
2024-08-19T05:37:20,419   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils
2024-08-19T05:37:20,420   copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/utils
2024-08-19T05:37:20,423   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion
2024-08-19T05:37:20,423   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-19T05:37:20,426   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-19T05:37:20,428   copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-19T05:37:20,430   copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-19T05:37:20,431   copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lion
2024-08-19T05:37:20,434   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam
2024-08-19T05:37:20,435   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-19T05:37:20,437   copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-19T05:37:20,439   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-19T05:37:20,441   copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-19T05:37:20,443   copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adam
2024-08-19T05:37:20,445   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention
2024-08-19T05:37:20,446   copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/sparse_attention
2024-08-19T05:37:20,449   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad
2024-08-19T05:37:20,450   copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/adagrad
2024-08-19T05:37:20,453   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization
2024-08-19T05:37:20,454   copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-19T05:37:20,456   copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-19T05:37:20,458   copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-19T05:37:20,460   copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-19T05:37:20,463   copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-19T05:37:20,465   copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-19T05:37:20,467   copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/quantization
2024-08-19T05:37:20,470   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb
2024-08-19T05:37:20,471   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-08-19T05:37:20,473   copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/lamb
2024-08-19T05:37:20,476   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu
2024-08-19T05:37:20,477   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/common
2024-08-19T05:37:20,479   copying build/lib/deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/common
2024-08-19T05:37:20,481   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adam
2024-08-19T05:37:20,482   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-08-19T05:37:20,485   copying build/lib/deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-08-19T05:37:20,487   copying build/lib/deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adam
2024-08-19T05:37:20,489   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/adagrad
2024-08-19T05:37:20,490   copying build/lib/deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/adagrad
2024-08-19T05:37:20,492   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/packbits
2024-08-19T05:37:20,493   copying build/lib/deepspeed/ops/csrc/xpu/packbits/packing.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/packbits
2024-08-19T05:37:20,496   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:20,497   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:20,499   copying build/lib/deepspeed/ops/csrc/xpu/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:20,501   copying build/lib/deepspeed/ops/csrc/xpu/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:20,503   copying build/lib/deepspeed/ops/csrc/xpu/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:20,505   copying build/lib/deepspeed/ops/csrc/xpu/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/xpu/includes
2024-08-19T05:37:20,507   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu
2024-08-19T05:37:20,509   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion
2024-08-19T05:37:20,510   copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/lion
2024-08-19T05:37:20,512   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam
2024-08-19T05:37:20,513   copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/adam
2024-08-19T05:37:20,516   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:20,516   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:20,519   copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:20,521   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm_interface.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:20,524   copying build/lib/deepspeed/ops/csrc/cpu/comm/shm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/cpu/comm
2024-08-19T05:37:20,526   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio
2024-08-19T05:37:20,527   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,528   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,531   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,533   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,535   copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,537   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,540   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,542   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,543   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,545   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,547   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,549   copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_lib
2024-08-19T05:37:20,551   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common
2024-08-19T05:37:20,552   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-19T05:37:20,554   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-19T05:37:20,556   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-19T05:37:20,558   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-19T05:37:20,560   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-19T05:37:20,562   copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/common
2024-08-19T05:37:20,564   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test
2024-08-19T05:37:20,565   copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/aio/py_test
2024-08-19T05:37:20,568   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes
2024-08-19T05:37:20,569   copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,571   copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,573   copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,576   copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,578   copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,580   copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,581   copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,584   copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,586   copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,587   copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,589   copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,591   copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,594   copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,596   copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,598   copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,600   copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,602   copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,603   copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,606   copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,608   copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,610   copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,612   copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,614   copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,617   copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,619   copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,621   copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,623   copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,626   copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,627   copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/includes
2024-08-19T05:37:20,630   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer
2024-08-19T05:37:20,631   copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-19T05:37:20,633   copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-19T05:37:20,637   copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-19T05:37:20,640   copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-19T05:37:20,644   copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-19T05:37:20,647   copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-19T05:37:20,650   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference
2024-08-19T05:37:20,652   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,654   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,656   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,659   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,661   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,665   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,668   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,671   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,675   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,679   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,682   copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/csrc
2024-08-19T05:37:20,685   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes
2024-08-19T05:37:20,686   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-08-19T05:37:20,689   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-08-19T05:37:20,692   copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer/inference/includes
2024-08-19T05:37:20,695   copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-19T05:37:20,700   copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/transformer
2024-08-19T05:37:20,703   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science
2024-08-19T05:37:20,705   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:20,707   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:20,713   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:20,714   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:20,717   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:20,720   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:20,723   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue
2024-08-19T05:37:20,725   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:20,728   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:20,731   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:20,734   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:20,735   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:20,739   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:20,742   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:20,745   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:20,748   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:20,751   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:20,753   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators
2024-08-19T05:37:20,758   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:20,761   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn
2024-08-19T05:37:20,764   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:20,765   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:20,769   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:20,771   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:20,774   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:20,777   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:20,782   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:20,785   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm
2024-08-19T05:37:20,788   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-19T05:37:20,789   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-19T05:37:20,792   copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform
2024-08-19T05:37:20,795   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial
2024-08-19T05:37:20,802   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc
2024-08-19T05:37:20,803   copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-08-19T05:37:20,806   copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/csrc
2024-08-19T05:37:20,809   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes
2024-08-19T05:37:20,810   copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/csrc/spatial/includes
2024-08-19T05:37:20,813   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer
2024-08-19T05:37:20,814   copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-08-19T05:37:20,817   copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer
2024-08-19T05:37:20,820   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference
2024-08-19T05:37:20,822   copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,824   copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,827   copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,830   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,832   copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,835   copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,837   copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,840   copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,842   copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,844   copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,846   copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,848   copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,850   copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,852   copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/triton
2024-08-19T05:37:20,855   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,856   copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,858   copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,860   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,862   copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,864   copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,866   copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,868   copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,869   copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,871   copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,873   copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference/op_binding
2024-08-19T05:37:20,875   copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,877   copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,879   copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,881   copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,884   copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,886   copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,888   copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/transformer/inference
2024-08-19T05:37:20,891   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science
2024-08-19T05:37:20,892   copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-08-19T05:37:20,893   copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/deepspeed4science
2024-08-19T05:37:20,896   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder
2024-08-19T05:37:20,898   copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,901   copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,902   copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,905   copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,906   copying build/lib/deepspeed/ops/op_builder/fp_quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,908   copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,910   copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,912   copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,914   copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,916   copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,918   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,919   copying build/lib/deepspeed/ops/op_builder/npu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,921   copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,923   copying build/lib/deepspeed/ops/op_builder/npu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,926   copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,927   copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,929   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,931   copying build/lib/deepspeed/ops/op_builder/npu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,933   copying build/lib/deepspeed/ops/op_builder/npu/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,935   copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/npu
2024-08-19T05:37:20,937   copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,938   copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,940   copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,942   copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,944   copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,946   copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,948   copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,950   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,951   copying build/lib/deepspeed/ops/op_builder/xpu/flash_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,953   copying build/lib/deepspeed/ops/op_builder/xpu/async_io.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,955   copying build/lib/deepspeed/ops/op_builder/xpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,957   copying build/lib/deepspeed/ops/op_builder/xpu/inference.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,959   copying build/lib/deepspeed/ops/op_builder/xpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,961   copying build/lib/deepspeed/ops/op_builder/xpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,963   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,964   copying build/lib/deepspeed/ops/op_builder/xpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,966   copying build/lib/deepspeed/ops/op_builder/xpu/packbits.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,968   copying build/lib/deepspeed/ops/op_builder/xpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/xpu
2024-08-19T05:37:20,970   copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,972   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu
2024-08-19T05:37:20,973   copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-19T05:37:20,975   copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-19T05:37:20,977   copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-19T05:37:20,979   copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-19T05:37:20,981   copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-19T05:37:20,983   copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/cpu
2024-08-19T05:37:20,984   copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,986   copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,988   copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:20,991   creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/hpu
2024-08-19T05:37:20,992   copying build/lib/deepspeed/ops/op_builder/hpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-19T05:37:20,994   copying build/lib/deepspeed/ops/op_builder/hpu/no_impl.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-19T05:37:20,996   copying build/lib/deepspeed/ops/op_builder/hpu/__init__.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-19T05:37:20,998   copying build/lib/deepspeed/ops/op_builder/hpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-19T05:37:21,000   copying build/lib/deepspeed/ops/op_builder/hpu/builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder/hpu
2024-08-19T05:37:21,002   copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:21,004   copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/./deepspeed/ops/op_builder
2024-08-19T05:37:21,006   copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/./deepspeed
2024-08-19T05:37:21,007   running install_egg_info
2024-08-19T05:37:21,039   Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/./deepspeed-0.14.5-py3.11.egg-info
2024-08-19T05:37:21,054   running install_scripts
2024-08-19T05:37:21,055   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data
2024-08-19T05:37:21,055   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts
2024-08-19T05:37:21,056   copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts
2024-08-19T05:37:21,058   copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts
2024-08-19T05:37:21,060   copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts
2024-08-19T05:37:21,062   copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts
2024-08-19T05:37:21,063   copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts
2024-08-19T05:37:21,065   copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts
2024-08-19T05:37:21,067   copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts
2024-08-19T05:37:21,069   copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts
2024-08-19T05:37:21,070   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts/ds_report to 755
2024-08-19T05:37:21,071   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts/ds to 755
2024-08-19T05:37:21,071   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts/ds_elastic to 755
2024-08-19T05:37:21,072   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts/ds_bench to 755
2024-08-19T05:37:21,072   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts/deepspeed.pt to 755
2024-08-19T05:37:21,073   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts/dsr to 755
2024-08-19T05:37:21,073   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts/ds_ssh to 755
2024-08-19T05:37:21,074   changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.data/scripts/deepspeed to 755
2024-08-19T05:37:21,121   creating build/bdist.linux-armv7l/wheel/deepspeed-0.14.5.dist-info/WHEEL
2024-08-19T05:37:21,123   creating '/tmp/pip-wheel-zutcplas/deepspeed-0.14.5-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it
2024-08-19T05:37:21,127   adding 'deepspeed/__init__.py'
2024-08-19T05:37:21,128   adding 'deepspeed/constants.py'
2024-08-19T05:37:21,130   adding 'deepspeed/env_report.py'
2024-08-19T05:37:21,131   adding 'deepspeed/git_version_info.py'
2024-08-19T05:37:21,133   adding 'deepspeed/git_version_info_installed.py'
2024-08-19T05:37:21,134   adding 'deepspeed/pydantic_v1.py'
2024-08-19T05:37:21,136   adding 'deepspeed/accelerator/__init__.py'
2024-08-19T05:37:21,137   adding 'deepspeed/accelerator/abstract_accelerator.py'
2024-08-19T05:37:21,139   adding 'deepspeed/accelerator/cpu_accelerator.py'
2024-08-19T05:37:21,141   adding 'deepspeed/accelerator/cuda_accelerator.py'
2024-08-19T05:37:21,143   adding 'deepspeed/accelerator/hpu_accelerator.py'
2024-08-19T05:37:21,145   adding 'deepspeed/accelerator/mps_accelerator.py'
2024-08-19T05:37:21,146   adding 'deepspeed/accelerator/npu_accelerator.py'
2024-08-19T05:37:21,148   adding 'deepspeed/accelerator/real_accelerator.py'
2024-08-19T05:37:21,150   adding 'deepspeed/accelerator/xpu_accelerator.py'
2024-08-19T05:37:21,152   adding 'deepspeed/autotuning/__init__.py'
2024-08-19T05:37:21,157   adding 'deepspeed/autotuning/autotuner.py'
2024-08-19T05:37:21,159   adding 'deepspeed/autotuning/config.py'
2024-08-19T05:37:21,160   adding 'deepspeed/autotuning/constants.py'
2024-08-19T05:37:21,162   adding 'deepspeed/autotuning/scheduler.py'
2024-08-19T05:37:21,164   adding 'deepspeed/autotuning/utils.py'
2024-08-19T05:37:21,166   adding 'deepspeed/autotuning/config_templates/template_zero0.json'
2024-08-19T05:37:21,167   adding 'deepspeed/autotuning/config_templates/template_zero1.json'
2024-08-19T05:37:21,169   adding 'deepspeed/autotuning/config_templates/template_zero2.json'
2024-08-19T05:37:21,170   adding 'deepspeed/autotuning/config_templates/template_zero3.json'
2024-08-19T05:37:21,171   adding 'deepspeed/autotuning/tuner/__init__.py'
2024-08-19T05:37:21,172   adding 'deepspeed/autotuning/tuner/base_tuner.py'
2024-08-19T05:37:21,174   adding 'deepspeed/autotuning/tuner/cost_model.py'
2024-08-19T05:37:21,175   adding 'deepspeed/autotuning/tuner/index_based_tuner.py'
2024-08-19T05:37:21,176   adding 'deepspeed/autotuning/tuner/model_based_tuner.py'
2024-08-19T05:37:21,178   adding 'deepspeed/autotuning/tuner/utils.py'
2024-08-19T05:37:21,179   adding 'deepspeed/checkpoint/__init__.py'
2024-08-19T05:37:21,181   adding 'deepspeed/checkpoint/constants.py'
2024-08-19T05:37:21,182   adding 'deepspeed/checkpoint/deepspeed_checkpoint.py'
2024-08-19T05:37:21,185   adding 'deepspeed/checkpoint/ds_to_universal.py'
2024-08-19T05:37:21,187   adding 'deepspeed/checkpoint/reshape_3d_utils.py'
2024-08-19T05:37:21,188   adding 'deepspeed/checkpoint/reshape_meg_2d.py'
2024-08-19T05:37:21,190   adding 'deepspeed/checkpoint/reshape_utils.py'
2024-08-19T05:37:21,191   adding 'deepspeed/checkpoint/universal_checkpoint.py'
2024-08-19T05:37:21,193   adding 'deepspeed/checkpoint/utils.py'
2024-08-19T05:37:21,194   adding 'deepspeed/checkpoint/zero_checkpoint.py'
2024-08-19T05:37:21,196   adding 'deepspeed/comm/__init__.py'
2024-08-19T05:37:21,197   adding 'deepspeed/comm/backend.py'
2024-08-19T05:37:21,198   adding 'deepspeed/comm/ccl.py'
2024-08-19T05:37:21,202   adding 'deepspeed/comm/comm.py'
2024-08-19T05:37:21,203   adding 'deepspeed/comm/config.py'
2024-08-19T05:37:21,204   adding 'deepspeed/comm/constants.py'
2024-08-19T05:37:21,205   adding 'deepspeed/comm/reduce_op.py'
2024-08-19T05:37:21,207   adding 'deepspeed/comm/torch.py'
2024-08-19T05:37:21,209   adding 'deepspeed/comm/utils.py'
2024-08-19T05:37:21,211   adding 'deepspeed/compression/__init__.py'
2024-08-19T05:37:21,214   adding 'deepspeed/compression/basic_layer.py'
2024-08-19T05:37:21,216   adding 'deepspeed/compression/compress.py'
2024-08-19T05:37:21,218   adding 'deepspeed/compression/config.py'
2024-08-19T05:37:21,220   adding 'deepspeed/compression/constants.py'
2024-08-19T05:37:21,222   adding 'deepspeed/compression/helper.py'
2024-08-19T05:37:21,223   adding 'deepspeed/compression/scheduler.py'
2024-08-19T05:37:21,225   adding 'deepspeed/compression/utils.py'
2024-08-19T05:37:21,226   adding 'deepspeed/elasticity/__init__.py'
2024-08-19T05:37:21,228   adding 'deepspeed/elasticity/config.py'
2024-08-19T05:37:21,229   adding 'deepspeed/elasticity/constants.py'
2024-08-19T05:37:21,231   adding 'deepspeed/elasticity/elastic_agent.py'
2024-08-19T05:37:21,233   adding 'deepspeed/elasticity/elasticity.py'
2024-08-19T05:37:21,235   adding 'deepspeed/elasticity/utils.py'
2024-08-19T05:37:21,236   adding 'deepspeed/inference/__init__.py'
2024-08-19T05:37:21,238   adding 'deepspeed/inference/config.py'
2024-08-19T05:37:21,242   adding 'deepspeed/inference/engine.py'
2024-08-19T05:37:21,244   adding 'deepspeed/inference/quantization/__init__.py'
2024-08-19T05:37:21,245   adding 'deepspeed/inference/quantization/layers.py'
2024-08-19T05:37:21,247   adding 'deepspeed/inference/quantization/quantization.py'
2024-08-19T05:37:21,248   adding 'deepspeed/inference/quantization/quantization_context.py'
2024-08-19T05:37:21,250   adding 'deepspeed/inference/quantization/utils.py'
2024-08-19T05:37:21,251   adding 'deepspeed/inference/v2/__init__.py'
2024-08-19T05:37:21,253   adding 'deepspeed/inference/v2/allocator.py'
2024-08-19T05:37:21,254   adding 'deepspeed/inference/v2/config_v2.py'
2024-08-19T05:37:21,255   adding 'deepspeed/inference/v2/engine_factory.py'
2024-08-19T05:37:21,257   adding 'deepspeed/inference/v2/engine_v2.py'
2024-08-19T05:37:21,259   adding 'deepspeed/inference/v2/inference_parameter.py'
2024-08-19T05:37:21,260   adding 'deepspeed/inference/v2/inference_utils.py'
2024-08-19T05:37:21,261   adding 'deepspeed/inference/v2/logging.py'
2024-08-19T05:37:21,262   adding 'deepspeed/inference/v2/scheduling_utils.py'
2024-08-19T05:37:21,264   adding 'deepspeed/inference/v2/checkpoint/__init__.py'
2024-08-19T05:37:21,265   adding 'deepspeed/inference/v2/checkpoint/base_engine.py'
2024-08-19T05:37:21,267   adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py'
2024-08-19T05:37:21,268   adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py'
2024-08-19T05:37:21,270   adding 'deepspeed/inference/v2/kernels/__init__.py'
2024-08-19T05:37:21,271   adding 'deepspeed/inference/v2/kernels/ds_kernel.py'
2024-08-19T05:37:21,273   adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py'
2024-08-19T05:37:21,274   adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp'
2024-08-19T05:37:21,275   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py'
2024-08-19T05:37:21,277   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp'
2024-08-19T05:37:21,278   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h'
2024-08-19T05:37:21,279   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py'
2024-08-19T05:37:21,281   adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation_cuda.cu'
2024-08-19T05:37:21,282   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py'
2024-08-19T05:37:21,284   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h'
2024-08-19T05:37:21,285   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py'
2024-08-19T05:37:21,287   adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h'
2024-08-19T05:37:21,289   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py'
2024-08-19T05:37:21,290   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py'
2024-08-19T05:37:21,291   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py'
2024-08-19T05:37:21,292   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py'
2024-08-19T05:37:21,293   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py'
2024-08-19T05:37:21,295   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp'
2024-08-19T05:37:21,296   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h'
2024-08-19T05:37:21,298   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm_cuda.cu'
2024-08-19T05:37:21,300   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/__init__.py'
2024-08-19T05:37:21,301   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/cuda_linear.py'
2024-08-19T05:37:21,303   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.cpp'
2024-08-19T05:37:21,305   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels.h'
2024-08-19T05:37:21,306   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.cu'
2024-08-19T05:37:21,308   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/linear_kernels_cuda.h'
2024-08-19T05:37:21,310   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/configs.h'
2024-08-19T05:37:21,312   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_matmul.cuh'
2024-08-19T05:37:21,313   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/kernel_reduction.cuh'
2024-08-19T05:37:21,314   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_cp.async.cuh'
2024-08-19T05:37:21,316   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/ptx_mma.cuh'
2024-08-19T05:37:21,317   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_core.cuh'
2024-08-19T05:37:21,319   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_gmem.cuh'
2024-08-19T05:37:21,320   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/utils_paralleldequant.cuh'
2024-08-19T05:37:21,322   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_linear/include/weight_prepacking.h'
2024-08-19T05:37:21,323   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py'
2024-08-19T05:37:21,325   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp'
2024-08-19T05:37:21,326   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h'
2024-08-19T05:37:21,327   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py'
2024-08-19T05:37:21,328   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py'
2024-08-19T05:37:21,330   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_cuda.cu'
2024-08-19T05:37:21,331   adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py'
2024-08-19T05:37:21,333   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py'
2024-08-19T05:37:21,334   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py'
2024-08-19T05:37:21,336   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp'
2024-08-19T05:37:21,337   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h'
2024-08-19T05:37:21,338   adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels_cuda.cu'
2024-08-19T05:37:21,340   adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py'
2024-08-19T05:37:21,341   adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp'
2024-08-19T05:37:21,343   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py'
2024-08-19T05:37:21,344   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu'
2024-08-19T05:37:21,346   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h'
2024-08-19T05:37:21,347   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py'
2024-08-19T05:37:21,348   adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h'
2024-08-19T05:37:21,350   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py'
2024-08-19T05:37:21,351   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py'
2024-08-19T05:37:21,353   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu'
2024-08-19T05:37:21,354   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h'
2024-08-19T05:37:21,355   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py'
2024-08-19T05:37:21,357   adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h'
2024-08-19T05:37:21,358   adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h'
2024-08-19T05:37:21,360   adding 'deepspeed/inference/v2/kernels/includes/activation_type.h'
2024-08-19T05:37:21,361   adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h'
2024-08-19T05:37:21,363   adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h'
2024-08-19T05:37:21,365   adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h'
2024-08-19T05:37:21,368   adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h'
2024-08-19T05:37:21,370   adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py'
2024-08-19T05:37:21,371   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp'
2024-08-19T05:37:21,373   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py'
2024-08-19T05:37:21,374   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp'
2024-08-19T05:37:21,376   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h'
2024-08-19T05:37:21,377   adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py'
2024-08-19T05:37:21,379   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py'
2024-08-19T05:37:21,380   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h'
2024-08-19T05:37:21,381   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp'
2024-08-19T05:37:21,382   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h'
2024-08-19T05:37:21,383   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py'
2024-08-19T05:37:21,385   adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h'
2024-08-19T05:37:21,386   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py'
2024-08-19T05:37:21,388   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp'
2024-08-19T05:37:21,389   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh'
2024-08-19T05:37:21,390   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h'
2024-08-19T05:37:21,391   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py'
2024-08-19T05:37:21,393   adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed_cuda.cu'
2024-08-19T05:37:21,395   adding 'deepspeed/inference/v2/kernels/ragged_ops/includes/top_k_utils.h'
2024-08-19T05:37:21,396   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py'
2024-08-19T05:37:21,398   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp'
2024-08-19T05:37:21,399   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh'
2024-08-19T05:37:21,400   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h'
2024-08-19T05:37:21,402   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py'
2024-08-19T05:37:21,404   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary_cuda.cu'
2024-08-19T05:37:21,405   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py'
2024-08-19T05:37:21,407   adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py'
2024-08-19T05:37:21,409   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py'
2024-08-19T05:37:21,410   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp'
2024-08-19T05:37:21,411   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh'
2024-08-19T05:37:21,413   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h'
2024-08-19T05:37:21,414   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py'
2024-08-19T05:37:21,415   adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather_cuda.cu'
2024-08-19T05:37:21,417   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py'
2024-08-19T05:37:21,419   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp'
2024-08-19T05:37:21,420   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh'
2024-08-19T05:37:21,421   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h'
2024-08-19T05:37:21,422   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py'
2024-08-19T05:37:21,424   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather_cuda.cu'
2024-08-19T05:37:21,426   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py'
2024-08-19T05:37:21,427   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp'
2024-08-19T05:37:21,429   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh'
2024-08-19T05:37:21,430   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h'
2024-08-19T05:37:21,431   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py'
2024-08-19T05:37:21,433   adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter_cuda.cu'
2024-08-19T05:37:21,434   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h'
2024-08-19T05:37:21,436   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp'
2024-08-19T05:37:21,437   adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h'
2024-08-19T05:37:21,438   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/__init__.py'
2024-08-19T05:37:21,439   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cpp'
2024-08-19T05:37:21,441   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.cuh'
2024-08-19T05:37:21,442   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.h'
2024-08-19T05:37:21,443   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating.py'
2024-08-19T05:37:21,445   adding 'deepspeed/inference/v2/kernels/ragged_ops/top_k_gating/top_k_gating_cuda.cu'
2024-08-19T05:37:21,447   adding 'deepspeed/inference/v2/model_implementations/__init__.py'
2024-08-19T05:37:21,448   adding 'deepspeed/inference/v2/model_implementations/flat_model_helpers.py'
2024-08-19T05:37:21,450   adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py'
2024-08-19T05:37:21,452   adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py'
2024-08-19T05:37:21,454   adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py'
2024-08-19T05:37:21,457   adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py'
2024-08-19T05:37:21,459   adding 'deepspeed/inference/v2/model_implementations/parameter_base.py'
2024-08-19T05:37:21,460   adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py'
2024-08-19T05:37:21,462   adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py'
2024-08-19T05:37:21,463   adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py'
2024-08-19T05:37:21,464   adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py'
2024-08-19T05:37:21,465   adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py'
2024-08-19T05:37:21,467   adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py'
2024-08-19T05:37:21,468   adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py'
2024-08-19T05:37:21,469   adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py'
2024-08-19T05:37:21,471   adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py'
2024-08-19T05:37:21,472   adding 'deepspeed/inference/v2/model_implementations/falcon/__init__.py'
2024-08-19T05:37:21,474   adding 'deepspeed/inference/v2/model_implementations/falcon/container.py'
2024-08-19T05:37:21,475   adding 'deepspeed/inference/v2/model_implementations/falcon/model.py'
2024-08-19T05:37:21,477   adding 'deepspeed/inference/v2/model_implementations/falcon/policy.py'
2024-08-19T05:37:21,478   adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py'
2024-08-19T05:37:21,480   adding 'deepspeed/inference/v2/model_implementations/llama_v2/container.py'
2024-08-19T05:37:21,481   adding 'deepspeed/inference/v2/model_implementations/llama_v2/model.py'
2024-08-19T05:37:21,483   adding 'deepspeed/inference/v2/model_implementations/llama_v2/policy.py'
2024-08-19T05:37:21,484   adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py'
2024-08-19T05:37:21,486   adding 'deepspeed/inference/v2/model_implementations/mistral/container.py'
2024-08-19T05:37:21,487   adding 'deepspeed/inference/v2/model_implementations/mistral/model.py'
2024-08-19T05:37:21,489   adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py'
2024-08-19T05:37:21,490   adding 'deepspeed/inference/v2/model_implementations/mixtral/__init__.py'
2024-08-19T05:37:21,491   adding 'deepspeed/inference/v2/model_implementations/mixtral/container.py'
2024-08-19T05:37:21,493   adding 'deepspeed/inference/v2/model_implementations/mixtral/model.py'
2024-08-19T05:37:21,494   adding 'deepspeed/inference/v2/model_implementations/mixtral/policy.py'
2024-08-19T05:37:21,496   adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py'
2024-08-19T05:37:21,497   adding 'deepspeed/inference/v2/model_implementations/opt/container.py'
2024-08-19T05:37:21,499   adding 'deepspeed/inference/v2/model_implementations/opt/model.py'
2024-08-19T05:37:21,500   adding 'deepspeed/inference/v2/model_implementations/opt/policy.py'
2024-08-19T05:37:21,502   adding 'deepspeed/inference/v2/model_implementations/phi/__init__.py'
2024-08-19T05:37:21,503   adding 'deepspeed/inference/v2/model_implementations/phi/containers.py'
2024-08-19T05:37:21,505   adding 'deepspeed/inference/v2/model_implementations/phi/model.py'
2024-08-19T05:37:21,506   adding 'deepspeed/inference/v2/model_implementations/phi/policy.py'
2024-08-19T05:37:21,508   adding 'deepspeed/inference/v2/model_implementations/phi3/__init__.py'
2024-08-19T05:37:21,509   adding 'deepspeed/inference/v2/model_implementations/phi3/containers.py'
2024-08-19T05:37:21,511   adding 'deepspeed/inference/v2/model_implementations/phi3/model.py'
2024-08-19T05:37:21,512   adding 'deepspeed/inference/v2/model_implementations/phi3/policy.py'
2024-08-19T05:37:21,514   adding 'deepspeed/inference/v2/model_implementations/qwen/__init__.py'
2024-08-19T05:37:21,515   adding 'deepspeed/inference/v2/model_implementations/qwen/container.py'
2024-08-19T05:37:21,517   adding 'deepspeed/inference/v2/model_implementations/qwen/model.py'
2024-08-19T05:37:21,518   adding 'deepspeed/inference/v2/model_implementations/qwen/policy.py'
2024-08-19T05:37:21,520   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/__init__.py'
2024-08-19T05:37:21,521   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/container.py'
2024-08-19T05:37:21,523   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/model.py'
2024-08-19T05:37:21,524   adding 'deepspeed/inference/v2/model_implementations/qwen_v2/policy.py'
2024-08-19T05:37:21,525   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/__init__.py'
2024-08-19T05:37:21,527   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/container.py'
2024-08-19T05:37:21,529   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/model.py'
2024-08-19T05:37:21,530   adding 'deepspeed/inference/v2/model_implementations/qwen_v2_moe/policy.py'
2024-08-19T05:37:21,532   adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py'
2024-08-19T05:37:21,533   adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py'
2024-08-19T05:37:21,534   adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py'
2024-08-19T05:37:21,536   adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py'
2024-08-19T05:37:21,537   adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py'
2024-08-19T05:37:21,538   adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py'
2024-08-19T05:37:21,540   adding 'deepspeed/inference/v2/model_implementations/sharding/types.py'
2024-08-19T05:37:21,541   adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py'
2024-08-19T05:37:21,542   adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py'
2024-08-19T05:37:21,544   adding 'deepspeed/inference/v2/modules/__init__.py'
2024-08-19T05:37:21,546   adding 'deepspeed/inference/v2/modules/ds_module.py'
2024-08-19T05:37:21,547   adding 'deepspeed/inference/v2/modules/heuristics.py'
2024-08-19T05:37:21,549   adding 'deepspeed/inference/v2/modules/module_registry.py'
2024-08-19T05:37:21,550   adding 'deepspeed/inference/v2/modules/configs/__init__.py'
2024-08-19T05:37:21,551   adding 'deepspeed/inference/v2/modules/configs/attention_configs.py'
2024-08-19T05:37:21,553   adding 'deepspeed/inference/v2/modules/configs/embedding_config.py'
2024-08-19T05:37:21,554   adding 'deepspeed/inference/v2/modules/configs/linear_config.py'
2024-08-19T05:37:21,555   adding 'deepspeed/inference/v2/modules/configs/moe_config.py'
2024-08-19T05:37:21,556   adding 'deepspeed/inference/v2/modules/configs/norm_config.py'
2024-08-19T05:37:21,558   adding 'deepspeed/inference/v2/modules/configs/unembed_config.py'
2024-08-19T05:37:21,559   adding 'deepspeed/inference/v2/modules/implementations/__init__.py'
2024-08-19T05:37:21,561   adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py'
2024-08-19T05:37:21,563   adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py'
2024-08-19T05:37:21,564   adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py'
2024-08-19T05:37:21,566   adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py'
2024-08-19T05:37:21,567   adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py'
2024-08-19T05:37:21,569   adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py'
2024-08-19T05:37:21,570   adding 'deepspeed/inference/v2/modules/implementations/linear/quantized_linear.py'
2024-08-19T05:37:21,572   adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py'
2024-08-19T05:37:21,574   adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py'
2024-08-19T05:37:21,575   adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py'
2024-08-19T05:37:21,577   adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py'
2024-08-19T05:37:21,578   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py'
2024-08-19T05:37:21,580   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py'
2024-08-19T05:37:21,581   adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py'
2024-08-19T05:37:21,583   adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py'
2024-08-19T05:37:21,584   adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py'
2024-08-19T05:37:21,586   adding 'deepspeed/inference/v2/modules/interfaces/__init__.py'
2024-08-19T05:37:21,587   adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py'
2024-08-19T05:37:21,589   adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py'
2024-08-19T05:37:21,590   adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py'
2024-08-19T05:37:21,591   adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py'
2024-08-19T05:37:21,593   adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py'
2024-08-19T05:37:21,594   adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py'
2024-08-19T05:37:21,595   adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py'
2024-08-19T05:37:21,597   adding 'deepspeed/inference/v2/ragged/__init__.py'
2024-08-19T05:37:21,599   adding 'deepspeed/inference/v2/ragged/blocked_allocator.py'
2024-08-19T05:37:21,601   adding 'deepspeed/inference/v2/ragged/kv_cache.py'
2024-08-19T05:37:21,603   adding 'deepspeed/inference/v2/ragged/manager_configs.py'
2024-08-19T05:37:21,605   adding 'deepspeed/inference/v2/ragged/ragged_manager.py'
2024-08-19T05:37:21,607   adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py'
2024-08-19T05:37:21,609   adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py'
2024-08-19T05:37:21,611   adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu'
2024-08-19T05:37:21,612   adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp'
2024-08-19T05:37:21,614   adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h'
2024-08-19T05:37:21,615   adding 'deepspeed/launcher/__init__.py'
2024-08-19T05:37:21,617   adding 'deepspeed/launcher/constants.py'
2024-08-19T05:37:21,619   adding 'deepspeed/launcher/launch.py'
2024-08-19T05:37:21,621   adding 'deepspeed/launcher/launcher_helper.py'
2024-08-19T05:37:21,623   adding 'deepspeed/launcher/multinode_runner.py'
2024-08-19T05:37:21,626   adding 'deepspeed/launcher/runner.py'
2024-08-19T05:37:21,628   adding 'deepspeed/linear/__init__.py'
2024-08-19T05:37:21,629   adding 'deepspeed/linear/config.py'
2024-08-19T05:37:21,630   adding 'deepspeed/linear/context_manager.py'
2024-08-19T05:37:21,632   adding 'deepspeed/linear/optimized_linear.py'
2024-08-19T05:37:21,634   adding 'deepspeed/linear/quantization.py'
2024-08-19T05:37:21,635   adding 'deepspeed/model_implementations/__init__.py'
2024-08-19T05:37:21,637   adding 'deepspeed/model_implementations/diffusers/__init__.py'
2024-08-19T05:37:21,638   adding 'deepspeed/model_implementations/diffusers/unet.py'
2024-08-19T05:37:21,639   adding 'deepspeed/model_implementations/diffusers/vae.py'
2024-08-19T05:37:21,641   adding 'deepspeed/model_implementations/features/__init__.py'
2024-08-19T05:37:21,642   adding 'deepspeed/model_implementations/features/cuda_graph.py'
2024-08-19T05:37:21,644   adding 'deepspeed/model_implementations/transformers/__init__.py'
2024-08-19T05:37:21,645   adding 'deepspeed/model_implementations/transformers/clip_encoder.py'
2024-08-19T05:37:21,646   adding 'deepspeed/model_implementations/transformers/ds_base.py'
2024-08-19T05:37:21,647   adding 'deepspeed/model_implementations/transformers/ds_bert.py'
2024-08-19T05:37:21,648   adding 'deepspeed/model_implementations/transformers/ds_bloom.py'
2024-08-19T05:37:21,649   adding 'deepspeed/model_implementations/transformers/ds_gpt.py'
2024-08-19T05:37:21,650   adding 'deepspeed/model_implementations/transformers/ds_llama2.py'
2024-08-19T05:37:21,651   adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py'
2024-08-19T05:37:21,653   adding 'deepspeed/model_implementations/transformers/ds_opt.py'
2024-08-19T05:37:21,654   adding 'deepspeed/model_implementations/transformers/ds_transformer.py'
2024-08-19T05:37:21,656   adding 'deepspeed/module_inject/__init__.py'
2024-08-19T05:37:21,659   adding 'deepspeed/module_inject/auto_tp.py'
2024-08-19T05:37:21,661   adding 'deepspeed/module_inject/auto_tp_model_utils.py'
2024-08-19T05:37:21,663   adding 'deepspeed/module_inject/fusedqkv_utils.py'
2024-08-19T05:37:21,664   adding 'deepspeed/module_inject/inject.py'
2024-08-19T05:37:21,666   adding 'deepspeed/module_inject/layers.py'
2024-08-19T05:37:21,668   adding 'deepspeed/module_inject/load_checkpoint.py'
2024-08-19T05:37:21,669   adding 'deepspeed/module_inject/module_quantize.py'
2024-08-19T05:37:21,671   adding 'deepspeed/module_inject/policy.py'
2024-08-19T05:37:21,674   adding 'deepspeed/module_inject/replace_module.py'
2024-08-19T05:37:21,676   adding 'deepspeed/module_inject/replace_policy.py'
2024-08-19T05:37:21,677   adding 'deepspeed/module_inject/tp_shard.py'
2024-08-19T05:37:21,678   adding 'deepspeed/module_inject/utils.py'
2024-08-19T05:37:21,680   adding 'deepspeed/module_inject/containers/__init__.py'
2024-08-19T05:37:21,682   adding 'deepspeed/module_inject/containers/base.py'
2024-08-19T05:37:21,683   adding 'deepspeed/module_inject/containers/base_moe.py'
2024-08-19T05:37:21,685   adding 'deepspeed/module_inject/containers/bert.py'
2024-08-19T05:37:21,686   adding 'deepspeed/module_inject/containers/bloom.py'
2024-08-19T05:37:21,688   adding 'deepspeed/module_inject/containers/clip.py'
2024-08-19T05:37:21,689   adding 'deepspeed/module_inject/containers/distil_bert.py'
2024-08-19T05:37:21,690   adding 'deepspeed/module_inject/containers/gpt2.py'
2024-08-19T05:37:21,692   adding 'deepspeed/module_inject/containers/gptj.py'
2024-08-19T05:37:21,696   adding 'deepspeed/module_inject/containers/gptneo.py'
2024-08-19T05:37:21,697   adding 'deepspeed/module_inject/containers/gptneox.py'
2024-08-19T05:37:21,699   adding 'deepspeed/module_inject/containers/internlm.py'
2024-08-19T05:37:21,701   adding 'deepspeed/module_inject/containers/llama.py'
2024-08-19T05:37:21,702   adding 'deepspeed/module_inject/containers/llama2.py'
2024-08-19T05:37:21,703   adding 'deepspeed/module_inject/containers/megatron_gpt.py'
2024-08-19T05:37:21,705   adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py'
2024-08-19T05:37:21,706   adding 'deepspeed/module_inject/containers/opt.py'
2024-08-19T05:37:21,707   adding 'deepspeed/module_inject/containers/unet.py'
2024-08-19T05:37:21,708   adding 'deepspeed/module_inject/containers/vae.py'
2024-08-19T05:37:21,710   adding 'deepspeed/module_inject/containers/features/__init__.py'
2024-08-19T05:37:21,711   adding 'deepspeed/module_inject/containers/features/gated_mlp.py'
2024-08-19T05:37:21,713   adding 'deepspeed/module_inject/containers/features/hybrid_engine.py'
2024-08-19T05:37:21,714   adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py'
2024-08-19T05:37:21,715   adding 'deepspeed/module_inject/containers/features/megatron.py'
2024-08-19T05:37:21,717   adding 'deepspeed/module_inject/containers/features/meta_tensor.py'
2024-08-19T05:37:21,718   adding 'deepspeed/module_inject/containers/features/split_qkv.py'
2024-08-19T05:37:21,720   adding 'deepspeed/moe/__init__.py'
2024-08-19T05:37:21,721   adding 'deepspeed/moe/experts.py'
2024-08-19T05:37:21,723   adding 'deepspeed/moe/layer.py'
2024-08-19T05:37:21,724   adding 'deepspeed/moe/mappings.py'
2024-08-19T05:37:21,727   adding 'deepspeed/moe/sharded_moe.py'
2024-08-19T05:37:21,729   adding 'deepspeed/moe/utils.py'
2024-08-19T05:37:21,731   adding 'deepspeed/monitor/__init__.py'
2024-08-19T05:37:21,732   adding 'deepspeed/monitor/comet.py'
2024-08-19T05:37:21,733   adding 'deepspeed/monitor/config.py'
2024-08-19T05:37:21,735   adding 'deepspeed/monitor/csv_monitor.py'
2024-08-19T05:37:21,736   adding 'deepspeed/monitor/monitor.py'
2024-08-19T05:37:21,737   adding 'deepspeed/monitor/tensorboard.py'
2024-08-19T05:37:21,738   adding 'deepspeed/monitor/utils.py'
2024-08-19T05:37:21,739   adding 'deepspeed/monitor/wandb.py'
2024-08-19T05:37:21,741   adding 'deepspeed/nebula/__init__.py'
2024-08-19T05:37:21,742   adding 'deepspeed/nebula/config.py'
2024-08-19T05:37:21,743   adding 'deepspeed/nebula/constants.py'
2024-08-19T05:37:21,746   adding 'deepspeed/ops/__init__.py'
2024-08-19T05:37:21,748   adding 'deepspeed/ops/adagrad/__init__.py'
2024-08-19T05:37:21,749   adding 'deepspeed/ops/adagrad/cpu_adagrad.py'
2024-08-19T05:37:21,751   adding 'deepspeed/ops/adam/__init__.py'
2024-08-19T05:37:21,753   adding 'deepspeed/ops/adam/cpu_adam.py'
2024-08-19T05:37:21,755   adding 'deepspeed/ops/adam/fused_adam.py'
2024-08-19T05:37:21,756   adding 'deepspeed/ops/adam/multi_tensor_apply.py'
2024-08-19T05:37:21,757   adding 'deepspeed/ops/aio/__init__.py'
2024-08-19T05:37:21,760   adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp'
2024-08-19T05:37:21,762   adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp'
2024-08-19T05:37:21,763   adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp'
2024-08-19T05:37:21,765   adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp'
2024-08-19T05:37:21,766   adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu'
2024-08-19T05:37:21,768   adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh'
2024-08-19T05:37:21,771   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp'
2024-08-19T05:37:21,772   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h'
2024-08-19T05:37:21,773   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp'
2024-08-19T05:37:21,774   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h'
2024-08-19T05:37:21,776   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp'
2024-08-19T05:37:21,777   adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h'
2024-08-19T05:37:21,779   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp'
2024-08-19T05:37:21,780   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h'
2024-08-19T05:37:21,782   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp'
2024-08-19T05:37:21,783   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h'
2024-08-19T05:37:21,784   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp'
2024-08-19T05:37:21,785   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h'
2024-08-19T05:37:21,787   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp'
2024-08-19T05:37:21,788   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h'
2024-08-19T05:37:21,790   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp'
2024-08-19T05:37:21,791   adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h'
2024-08-19T05:37:21,792   adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp'
2024-08-19T05:37:21,793   adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json'
2024-08-19T05:37:21,795   adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp'
2024-08-19T05:37:21,798   adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp'
2024-08-19T05:37:21,801   adding 'deepspeed/ops/csrc/cpu/comm/shm.cpp'
2024-08-19T05:37:21,802   adding 'deepspeed/ops/csrc/cpu/comm/shm.h'
2024-08-19T05:37:21,803   adding 'deepspeed/ops/csrc/cpu/comm/shm_interface.cpp'
2024-08-19T05:37:21,805   adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp'
2024-08-19T05:37:21,807   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp'
2024-08-19T05:37:21,809   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu'
2024-08-19T05:37:21,811   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu'
2024-08-19T05:37:21,812   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h'
2024-08-19T05:37:21,820   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h'
2024-08-19T05:37:21,825   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h'
2024-08-19T05:37:21,827   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h'
2024-08-19T05:37:21,830   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h'
2024-08-19T05:37:21,832   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h'
2024-08-19T05:37:21,833   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h'
2024-08-19T05:37:21,835   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h'
2024-08-19T05:37:21,837   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h'
2024-08-19T05:37:21,840   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h'
2024-08-19T05:37:21,842   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h'
2024-08-19T05:37:21,844   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h'
2024-08-19T05:37:21,846   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h'
2024-08-19T05:37:21,853   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h'
2024-08-19T05:37:21,856   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h'
2024-08-19T05:37:21,858   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h'
2024-08-19T05:37:21,862   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h'
2024-08-19T05:37:21,865   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h'
2024-08-19T05:37:21,869   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h'
2024-08-19T05:37:21,871   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h'
2024-08-19T05:37:21,873   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h'
2024-08-19T05:37:21,875   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h'
2024-08-19T05:37:21,876   adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h'
2024-08-19T05:37:21,878   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cpp'
2024-08-19T05:37:21,880   adding 'deepspeed/ops/csrc/fp_quantizer/fp_quantize.cu'
2024-08-19T05:37:21,882   adding 'deepspeed/ops/csrc/fp_quantizer/includes/context.h'
2024-08-19T05:37:21,884   adding 'deepspeed/ops/csrc/fp_quantizer/includes/fp_quantize.h'
2024-08-19T05:37:21,886   adding 'deepspeed/ops/csrc/includes/StopWatch.h'
2024-08-19T05:37:21,887   adding 'deepspeed/ops/csrc/includes/Timer.h'
2024-08-19T05:37:21,888   adding 'deepspeed/ops/csrc/includes/activation_type.h'
2024-08-19T05:37:21,889   adding 'deepspeed/ops/csrc/includes/compat.h'
2024-08-19T05:37:21,891   adding 'deepspeed/ops/csrc/includes/context.h'
2024-08-19T05:37:21,893   adding 'deepspeed/ops/csrc/includes/conversion_utils.h'
2024-08-19T05:37:21,894   adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h'
2024-08-19T05:37:21,896   adding 'deepspeed/ops/csrc/includes/cpu_adam.h'
2024-08-19T05:37:21,897   adding 'deepspeed/ops/csrc/includes/cpu_lion.h'
2024-08-19T05:37:21,899   adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h'
2024-08-19T05:37:21,901   adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h'
2024-08-19T05:37:21,902   adding 'deepspeed/ops/csrc/includes/dequantization_utils.h'
2024-08-19T05:37:21,904   adding 'deepspeed/ops/csrc/includes/dropout.h'
2024-08-19T05:37:21,905   adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h'
2024-08-19T05:37:21,906   adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h'
2024-08-19T05:37:21,908   adding 'deepspeed/ops/csrc/includes/feed_forward.h'
2024-08-19T05:37:21,909   adding 'deepspeed/ops/csrc/includes/gelu.h'
2024-08-19T05:37:21,911   adding 'deepspeed/ops/csrc/includes/gemm_test.h'
2024-08-19T05:37:21,912   adding 'deepspeed/ops/csrc/includes/general_kernels.h'
2024-08-19T05:37:21,915   adding 'deepspeed/ops/csrc/includes/memory_access_utils.h'
2024-08-19T05:37:21,917   adding 'deepspeed/ops/csrc/includes/normalize_layer.h'
2024-08-19T05:37:21,918   adding 'deepspeed/ops/csrc/includes/quantization.h'
2024-08-19T05:37:21,920   adding 'deepspeed/ops/csrc/includes/quantization_utils.h'
2024-08-19T05:37:21,922   adding 'deepspeed/ops/csrc/includes/quantizer.h'
2024-08-19T05:37:21,924   adding 'deepspeed/ops/csrc/includes/reduction_utils.h'
2024-08-19T05:37:21,926   adding 'deepspeed/ops/csrc/includes/simd.h'
2024-08-19T05:37:21,927   adding 'deepspeed/ops/csrc/includes/softmax.h'
2024-08-19T05:37:21,929   adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h'
2024-08-19T05:37:21,930   adding 'deepspeed/ops/csrc/includes/type_shim.h'
2024-08-19T05:37:21,932   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp'
2024-08-19T05:37:21,934   adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu'
2024-08-19T05:37:21,936   adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp'
2024-08-19T05:37:21,937   adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp'
2024-08-19T05:37:21,939   adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp'
2024-08-19T05:37:21,940   adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh'
2024-08-19T05:37:21,942   adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu'
2024-08-19T05:37:21,944   adding 'deepspeed/ops/csrc/quantization/dequantize.cu'
2024-08-19T05:37:21,947   adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu'
2024-08-19T05:37:21,949   adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp'
2024-08-19T05:37:21,951   adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu'
2024-08-19T05:37:21,952   adding 'deepspeed/ops/csrc/quantization/quantize.cu'
2024-08-19T05:37:21,954   adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu'
2024-08-19T05:37:21,956   adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu'
2024-08-19T05:37:21,958   adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu'
2024-08-19T05:37:21,959   adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp'
2024-08-19T05:37:21,961   adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu'
2024-08-19T05:37:21,962   adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu'
2024-08-19T05:37:21,964   adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp'
2024-08-19T05:37:21,966   adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu'
2024-08-19T05:37:21,967   adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp'
2024-08-19T05:37:21,969   adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h'
2024-08-19T05:37:21,971   adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu'
2024-08-19T05:37:21,974   adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu'
2024-08-19T05:37:21,978   adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp'
2024-08-19T05:37:21,979   adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu'
2024-08-19T05:37:21,981   adding 'deepspeed/ops/csrc/transformer/general_kernels.cu'
2024-08-19T05:37:21,985   adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu'
2024-08-19T05:37:21,988   adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu'
2024-08-19T05:37:21,991   adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu'
2024-08-19T05:37:21,994   adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu'
2024-08-19T05:37:21,995   adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu'
2024-08-19T05:37:21,998   adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu'
2024-08-19T05:37:22,000   adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu'
2024-08-19T05:37:22,002   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu'
2024-08-19T05:37:22,007   adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp'
2024-08-19T05:37:22,009   adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu'
2024-08-19T05:37:22,011   adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu'
2024-08-19T05:37:22,014   adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu'
2024-08-19T05:37:22,016   adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu'
2024-08-19T05:37:22,019   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h'
2024-08-19T05:37:22,021   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h'
2024-08-19T05:37:22,022   adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h'
2024-08-19T05:37:22,024   adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp'
2024-08-19T05:37:22,026   adding 'deepspeed/ops/csrc/xpu/adagrad/cpu_adagrad.cpp'
2024-08-19T05:37:22,028   adding 'deepspeed/ops/csrc/xpu/adam/fused_adam_frontend.cpp'
2024-08-19T05:37:22,029   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_adam.dp.cpp'
2024-08-19T05:37:22,031   adding 'deepspeed/ops/csrc/xpu/adam/multi_tensor_apply.dp.hpp'
2024-08-19T05:37:22,033   adding 'deepspeed/ops/csrc/xpu/common/custom_cuda_kernel.dp.cpp'
2024-08-19T05:37:22,035   adding 'deepspeed/ops/csrc/xpu/includes/compat.h'
2024-08-19T05:37:22,036   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adagrad.h'
2024-08-19T05:37:22,038   adding 'deepspeed/ops/csrc/xpu/includes/cpu_adam.h'
2024-08-19T05:37:22,039   adding 'deepspeed/ops/csrc/xpu/includes/simd.h'
2024-08-19T05:37:22,041   adding 'deepspeed/ops/csrc/xpu/includes/type_shim.h'
2024-08-19T05:37:22,043   adding 'deepspeed/ops/csrc/xpu/packbits/packing.cpp'
2024-08-19T05:37:22,045   adding 'deepspeed/ops/deepspeed4science/__init__.py'
2024-08-19T05:37:22,046   adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py'
2024-08-19T05:37:22,048   adding 'deepspeed/ops/fp_quantizer/__init__.py'
2024-08-19T05:37:22,049   adding 'deepspeed/ops/fp_quantizer/fp8_gemm.py'
2024-08-19T05:37:22,051   adding 'deepspeed/ops/fp_quantizer/quantize.py'
2024-08-19T05:37:22,053   adding 'deepspeed/ops/lamb/__init__.py'
2024-08-19T05:37:22,054   adding 'deepspeed/ops/lamb/fused_lamb.py'
2024-08-19T05:37:22,056   adding 'deepspeed/ops/lion/__init__.py'
2024-08-19T05:37:22,058   adding 'deepspeed/ops/lion/cpu_lion.py'
2024-08-19T05:37:22,059   adding 'deepspeed/ops/lion/fused_lion.py'
2024-08-19T05:37:22,060   adding 'deepspeed/ops/lion/multi_tensor_apply.py'
2024-08-19T05:37:22,062   adding 'deepspeed/ops/op_builder/__init__.py'
2024-08-19T05:37:22,064   adding 'deepspeed/ops/op_builder/all_ops.py'
2024-08-19T05:37:22,065   adding 'deepspeed/ops/op_builder/async_io.py'
2024-08-19T05:37:22,069   adding 'deepspeed/ops/op_builder/builder.py'
2024-08-19T05:37:22,070   adding 'deepspeed/ops/op_builder/cpu_adagrad.py'
2024-08-19T05:37:22,071   adding 'deepspeed/ops/op_builder/cpu_adam.py'
2024-08-19T05:37:22,073   adding 'deepspeed/ops/op_builder/cpu_lion.py'
2024-08-19T05:37:22,074   adding 'deepspeed/ops/op_builder/evoformer_attn.py'
2024-08-19T05:37:22,075   adding 'deepspeed/ops/op_builder/fp_quantizer.py'
2024-08-19T05:37:22,076   adding 'deepspeed/ops/op_builder/fused_adam.py'
2024-08-19T05:37:22,078   adding 'deepspeed/ops/op_builder/fused_lamb.py'
2024-08-19T05:37:22,079   adding 'deepspeed/ops/op_builder/fused_lion.py'
2024-08-19T05:37:22,081   adding 'deepspeed/ops/op_builder/inference_core_ops.py'
2024-08-19T05:37:22,082   adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py'
2024-08-19T05:37:22,083   adding 'deepspeed/ops/op_builder/quantizer.py'
2024-08-19T05:37:22,085   adding 'deepspeed/ops/op_builder/ragged_ops.py'
2024-08-19T05:37:22,086   adding 'deepspeed/ops/op_builder/ragged_utils.py'
2024-08-19T05:37:22,087   adding 'deepspeed/ops/op_builder/random_ltd.py'
2024-08-19T05:37:22,089   adding 'deepspeed/ops/op_builder/sparse_attn.py'
2024-08-19T05:37:22,090   adding 'deepspeed/ops/op_builder/spatial_inference.py'
2024-08-19T05:37:22,091   adding 'deepspeed/ops/op_builder/stochastic_transformer.py'
2024-08-19T05:37:22,092   adding 'deepspeed/ops/op_builder/transformer.py'
2024-08-19T05:37:22,094   adding 'deepspeed/ops/op_builder/transformer_inference.py'
2024-08-19T05:37:22,095   adding 'deepspeed/ops/op_builder/cpu/__init__.py'
2024-08-19T05:37:22,097   adding 'deepspeed/ops/op_builder/cpu/builder.py'
2024-08-19T05:37:22,098   adding 'deepspeed/ops/op_builder/cpu/comm.py'
2024-08-19T05:37:22,099   adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py'
2024-08-19T05:37:22,100   adding 'deepspeed/ops/op_builder/cpu/fused_adam.py'
2024-08-19T05:37:22,102   adding 'deepspeed/ops/op_builder/cpu/no_impl.py'
2024-08-19T05:37:22,103   adding 'deepspeed/ops/op_builder/hpu/__init__.py'
2024-08-19T05:37:22,104   adding 'deepspeed/ops/op_builder/hpu/builder.py'
2024-08-19T05:37:22,106   adding 'deepspeed/ops/op_builder/hpu/cpu_adam.py'
2024-08-19T05:37:22,107   adding 'deepspeed/ops/op_builder/hpu/fused_adam.py'
2024-08-19T05:37:22,108   adding 'deepspeed/ops/op_builder/hpu/no_impl.py'
2024-08-19T05:37:22,110   adding 'deepspeed/ops/op_builder/npu/__init__.py'
2024-08-19T05:37:22,112   adding 'deepspeed/ops/op_builder/npu/async_io.py'
2024-08-19T05:37:22,113   adding 'deepspeed/ops/op_builder/npu/builder.py'
2024-08-19T05:37:22,114   adding 'deepspeed/ops/op_builder/npu/cpu_adagrad.py'
2024-08-19T05:37:22,115   adding 'deepspeed/ops/op_builder/npu/cpu_adam.py'
2024-08-19T05:37:22,116   adding 'deepspeed/ops/op_builder/npu/cpu_lion.py'
2024-08-19T05:37:22,118   adding 'deepspeed/ops/op_builder/npu/fused_adam.py'
2024-08-19T05:37:22,119   adding 'deepspeed/ops/op_builder/npu/inference.py'
2024-08-19T05:37:22,121   adding 'deepspeed/ops/op_builder/npu/no_impl.py'
2024-08-19T05:37:22,122   adding 'deepspeed/ops/op_builder/xpu/__init__.py'
2024-08-19T05:37:22,124   adding 'deepspeed/ops/op_builder/xpu/async_io.py'
2024-08-19T05:37:22,125   adding 'deepspeed/ops/op_builder/xpu/builder.py'
2024-08-19T05:37:22,126   adding 'deepspeed/ops/op_builder/xpu/cpu_adagrad.py'
2024-08-19T05:37:22,128   adding 'deepspeed/ops/op_builder/xpu/cpu_adam.py'
2024-08-19T05:37:22,129   adding 'deepspeed/ops/op_builder/xpu/flash_attn.py'
2024-08-19T05:37:22,130   adding 'deepspeed/ops/op_builder/xpu/fused_adam.py'
2024-08-19T05:37:22,132   adding 'deepspeed/ops/op_builder/xpu/inference.py'
2024-08-19T05:37:22,133   adding 'deepspeed/ops/op_builder/xpu/no_impl.py'
2024-08-19T05:37:22,134   adding 'deepspeed/ops/op_builder/xpu/packbits.py'
2024-08-19T05:37:22,136   adding 'deepspeed/ops/quantizer/__init__.py'
2024-08-19T05:37:22,137   adding 'deepspeed/ops/quantizer/quantizer.py'
2024-08-19T05:37:22,138   adding 'deepspeed/ops/random_ltd/__init__.py'
2024-08-19T05:37:22,140   adding 'deepspeed/ops/random_ltd/dropping_utils.py'
2024-08-19T05:37:22,141   adding 'deepspeed/ops/sparse_attention/__init__.py'
2024-08-19T05:37:22,143   adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py'
2024-08-19T05:37:22,146   adding 'deepspeed/ops/sparse_attention/matmul.py'
2024-08-19T05:37:22,148   adding 'deepspeed/ops/sparse_attention/softmax.py'
2024-08-19T05:37:22,150   adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py'
2024-08-19T05:37:22,152   adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py'
2024-08-19T05:37:22,155   adding 'deepspeed/ops/sparse_attention/sparsity_config.py'
2024-08-19T05:37:22,157   adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py'
2024-08-19T05:37:22,158   adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr'
2024-08-19T05:37:22,160   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr'
2024-08-19T05:37:22,161   adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr'
2024-08-19T05:37:22,163   adding 'deepspeed/ops/transformer/__init__.py'
2024-08-19T05:37:22,165   adding 'deepspeed/ops/transformer/transformer.py'
2024-08-19T05:37:22,167   adding 'deepspeed/ops/transformer/inference/__init__.py'
2024-08-19T05:37:22,168   adding 'deepspeed/ops/transformer/inference/bias_add.py'
2024-08-19T05:37:22,169   adding 'deepspeed/ops/transformer/inference/config.py'
2024-08-19T05:37:22,170   adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py'
2024-08-19T05:37:22,172   adding 'deepspeed/ops/transformer/inference/diffusers_attention.py'
2024-08-19T05:37:22,174   adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py'
2024-08-19T05:37:22,175   adding 'deepspeed/ops/transformer/inference/ds_attention.py'
2024-08-19T05:37:22,177   adding 'deepspeed/ops/transformer/inference/ds_mlp.py'
2024-08-19T05:37:22,179   adding 'deepspeed/ops/transformer/inference/moe_inference.py'
2024-08-19T05:37:22,181   adding 'deepspeed/ops/transformer/inference/triton_ops.py'
2024-08-19T05:37:22,182   adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py'
2024-08-19T05:37:22,184   adding 'deepspeed/ops/transformer/inference/op_binding/base.py'
2024-08-19T05:37:22,185   adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py'
2024-08-19T05:37:22,186   adding 'deepspeed/ops/transformer/inference/op_binding/linear.py'
2024-08-19T05:37:22,188   adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py'
2024-08-19T05:37:22,189   adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py'
2024-08-19T05:37:22,190   adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py'
2024-08-19T05:37:22,192   adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py'
2024-08-19T05:37:22,193   adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py'
2024-08-19T05:37:22,194   adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py'
2024-08-19T05:37:22,196   adding 'deepspeed/ops/transformer/inference/triton/__init__.py'
2024-08-19T05:37:22,199   adding 'deepspeed/ops/transformer/inference/triton/attention.py'
2024-08-19T05:37:22,200   adding 'deepspeed/ops/transformer/inference/triton/gelu.py'
2024-08-19T05:37:22,202   adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py'
2024-08-19T05:37:22,204   adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py'
2024-08-19T05:37:22,205   adding 'deepspeed/ops/transformer/inference/triton/mlp.py'
2024-08-19T05:37:22,207   adding 'deepspeed/ops/transformer/inference/triton/ops.py'
2024-08-19T05:37:22,208   adding 'deepspeed/ops/transformer/inference/triton/residual_add.py'
2024-08-19T05:37:22,209   adding 'deepspeed/ops/transformer/inference/triton/softmax.py'
2024-08-19T05:37:22,211   adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py'
2024-08-19T05:37:22,213   adding 'deepspeed/pipe/__init__.py'
2024-08-19T05:37:22,215   adding 'deepspeed/profiling/__init__.py'
2024-08-19T05:37:22,216   adding 'deepspeed/profiling/config.py'
2024-08-19T05:37:22,217   adding 'deepspeed/profiling/constants.py'
2024-08-19T05:37:22,219   adding 'deepspeed/profiling/flops_profiler/__init__.py'
2024-08-19T05:37:22,224   adding 'deepspeed/profiling/flops_profiler/profiler.py'
2024-08-19T05:37:22,226   adding 'deepspeed/runtime/__init__.py'
2024-08-19T05:37:22,227   adding 'deepspeed/runtime/base_optimizer.py'
2024-08-19T05:37:22,230   adding 'deepspeed/runtime/bf16_optimizer.py'
2024-08-19T05:37:22,232   adding 'deepspeed/runtime/compiler.py'
2024-08-19T05:37:22,236   adding 'deepspeed/runtime/config.py'
2024-08-19T05:37:22,238   adding 'deepspeed/runtime/config_utils.py'
2024-08-19T05:37:22,240   adding 'deepspeed/runtime/constants.py'
2024-08-19T05:37:22,241   adding 'deepspeed/runtime/dataloader.py'
2024-08-19T05:37:22,243   adding 'deepspeed/runtime/eigenvalue.py'
2024-08-19T05:37:22,261   adding 'deepspeed/runtime/engine.py'
2024-08-19T05:37:22,264   adding 'deepspeed/runtime/hybrid_engine.py'
2024-08-19T05:37:22,268   adding 'deepspeed/runtime/lr_schedules.py'
2024-08-19T05:37:22,270   adding 'deepspeed/runtime/progressive_layer_drop.py'
2024-08-19T05:37:22,271   adding 'deepspeed/runtime/quantize.py'
2024-08-19T05:37:22,273   adding 'deepspeed/runtime/sparse_tensor.py'
2024-08-19T05:37:22,275   adding 'deepspeed/runtime/state_dict_factory.py'
2024-08-19T05:37:22,280   adding 'deepspeed/runtime/utils.py'
2024-08-19T05:37:22,282   adding 'deepspeed/runtime/weight_quantizer.py'
2024-08-19T05:37:22,284   adding 'deepspeed/runtime/activation_checkpointing/__init__.py'
2024-08-19T05:37:22,289   adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py'
2024-08-19T05:37:22,290   adding 'deepspeed/runtime/activation_checkpointing/config.py'
2024-08-19T05:37:22,292   adding 'deepspeed/runtime/checkpoint_engine/__init__.py'
2024-08-19T05:37:22,293   adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py'
2024-08-19T05:37:22,294   adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py'
2024-08-19T05:37:22,295   adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py'
2024-08-19T05:37:22,297   adding 'deepspeed/runtime/comm/__init__.py'
2024-08-19T05:37:22,299   adding 'deepspeed/runtime/comm/coalesced_collectives.py'
2024-08-19T05:37:22,300   adding 'deepspeed/runtime/comm/compressed.py'
2024-08-19T05:37:22,302   adding 'deepspeed/runtime/comm/hccl.py'
2024-08-19T05:37:22,303   adding 'deepspeed/runtime/comm/mpi.py'
2024-08-19T05:37:22,305   adding 'deepspeed/runtime/comm/nccl.py'
2024-08-19T05:37:22,307   adding 'deepspeed/runtime/compression/__init__.py'
2024-08-19T05:37:22,308   adding 'deepspeed/runtime/compression/cupy.py'
2024-08-19T05:37:22,309   adding 'deepspeed/runtime/data_pipeline/__init__.py'
2024-08-19T05:37:22,311   adding 'deepspeed/runtime/data_pipeline/config.py'
2024-08-19T05:37:22,312   adding 'deepspeed/runtime/data_pipeline/constants.py'
2024-08-19T05:37:22,314   adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py'
2024-08-19T05:37:22,315   adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py'
2024-08-19T05:37:22,317   adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py'
2024-08-19T05:37:22,318   adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py'
2024-08-19T05:37:22,319   adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py'
2024-08-19T05:37:22,321   adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py'
2024-08-19T05:37:22,323   adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py'
2024-08-19T05:37:22,328   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py'
2024-08-19T05:37:22,331   adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py'
2024-08-19T05:37:22,334   adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py'
2024-08-19T05:37:22,335   adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py'
2024-08-19T05:37:22,337   adding 'deepspeed/runtime/fp16/__init__.py'
2024-08-19T05:37:22,340   adding 'deepspeed/runtime/fp16/fused_optimizer.py'
2024-08-19T05:37:22,342   adding 'deepspeed/runtime/fp16/loss_scaler.py'
2024-08-19T05:37:22,344   adding 'deepspeed/runtime/fp16/unfused_optimizer.py'
2024-08-19T05:37:22,346   adding 'deepspeed/runtime/fp16/onebit/__init__.py'
2024-08-19T05:37:22,348   adding 'deepspeed/runtime/fp16/onebit/adam.py'
2024-08-19T05:37:22,351   adding 'deepspeed/runtime/fp16/onebit/lamb.py'
2024-08-19T05:37:22,353   adding 'deepspeed/runtime/fp16/onebit/zoadam.py'
2024-08-19T05:37:22,355   adding 'deepspeed/runtime/pipe/__init__.py'
2024-08-19T05:37:22,361   adding 'deepspeed/runtime/pipe/engine.py'
2024-08-19T05:37:22,365   adding 'deepspeed/runtime/pipe/module.py'
2024-08-19T05:37:22,367   adding 'deepspeed/runtime/pipe/p2p.py'
2024-08-19T05:37:22,369   adding 'deepspeed/runtime/pipe/schedule.py'
2024-08-19T05:37:22,372   adding 'deepspeed/runtime/pipe/topology.py'
2024-08-19T05:37:22,374   adding 'deepspeed/runtime/swap_tensor/__init__.py'
2024-08-19T05:37:22,375   adding 'deepspeed/runtime/swap_tensor/aio_config.py'
2024-08-19T05:37:22,376   adding 'deepspeed/runtime/swap_tensor/async_swapper.py'
2024-08-19T05:37:22,378   adding 'deepspeed/runtime/swap_tensor/constants.py'
2024-08-19T05:37:22,380   adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py'
2024-08-19T05:37:22,382   adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py'
2024-08-19T05:37:22,384   adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py'
2024-08-19T05:37:22,386   adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py'
2024-08-19T05:37:22,388   adding 'deepspeed/runtime/swap_tensor/utils.py'
2024-08-19T05:37:22,390   adding 'deepspeed/runtime/zero/__init__.py'
2024-08-19T05:37:22,392   adding 'deepspeed/runtime/zero/config.py'
2024-08-19T05:37:22,394   adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py'
2024-08-19T05:37:22,395   adding 'deepspeed/runtime/zero/linear.py'
2024-08-19T05:37:22,398   adding 'deepspeed/runtime/zero/mics.py'
2024-08-19T05:37:22,400   adding 'deepspeed/runtime/zero/mics_utils.py'
2024-08-19T05:37:22,401   adding 'deepspeed/runtime/zero/offload_config.py'
2024-08-19T05:37:22,404   adding 'deepspeed/runtime/zero/parameter_offload.py'
2024-08-19T05:37:22,416   adding 'deepspeed/runtime/zero/partition_parameters.py'
2024-08-19T05:37:22,420   adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py'
2024-08-19T05:37:22,421   adding 'deepspeed/runtime/zero/partitioned_param_profiler.py'
2024-08-19T05:37:22,436   adding 'deepspeed/runtime/zero/stage3.py'
2024-08-19T05:37:22,450   adding 'deepspeed/runtime/zero/stage_1_and_2.py'
2024-08-19T05:37:22,452   adding 'deepspeed/runtime/zero/test.py'
2024-08-19T05:37:22,455   adding 'deepspeed/runtime/zero/tiling.py'
2024-08-19T05:37:22,457   adding 'deepspeed/runtime/zero/utils.py'
2024-08-19T05:37:22,458   adding 'deepspeed/sequence/__init__.py'
2024-08-19T05:37:22,460   adding 'deepspeed/sequence/layer.py'
2024-08-19T05:37:22,462   adding 'deepspeed/utils/__init__.py'
2024-08-19T05:37:22,463   adding 'deepspeed/utils/bwc.py'
2024-08-19T05:37:22,465   adding 'deepspeed/utils/comms_logging.py'
2024-08-19T05:37:22,466   adding 'deepspeed/utils/config.py'
2024-08-19T05:37:22,468   adding 'deepspeed/utils/debug.py'
2024-08-19T05:37:22,469   adding 'deepspeed/utils/exceptions.py'
2024-08-19T05:37:22,472   adding 'deepspeed/utils/groups.py'
2024-08-19T05:37:22,473   adding 'deepspeed/utils/init_on_device.py'
2024-08-19T05:37:22,475   adding 'deepspeed/utils/logging.py'
2024-08-19T05:37:22,476   adding 'deepspeed/utils/mixed_precision_linkage.py'
2024-08-19T05:37:22,478   adding 'deepspeed/utils/numa.py'
2024-08-19T05:37:22,480   adding 'deepspeed/utils/nvtx.py'
2024-08-19T05:37:22,482   adding 'deepspeed/utils/tensor_fragment.py'
2024-08-19T05:37:22,484   adding 'deepspeed/utils/timer.py'
2024-08-19T05:37:22,485   adding 'deepspeed/utils/torch.py'
2024-08-19T05:37:22,486   adding 'deepspeed/utils/types.py'
2024-08-19T05:37:22,487   adding 'deepspeed/utils/z3_leaf_module.py'
2024-08-19T05:37:22,490   adding 'deepspeed/utils/zero_to_fp32.py'
2024-08-19T05:37:22,493   adding 'deepspeed-0.14.5.data/scripts/deepspeed'
2024-08-19T05:37:22,494   adding 'deepspeed-0.14.5.data/scripts/deepspeed.pt'
2024-08-19T05:37:22,495   adding 'deepspeed-0.14.5.data/scripts/ds'
2024-08-19T05:37:22,496   adding 'deepspeed-0.14.5.data/scripts/ds_bench'
2024-08-19T05:37:22,498   adding 'deepspeed-0.14.5.data/scripts/ds_elastic'
2024-08-19T05:37:22,499   adding 'deepspeed-0.14.5.data/scripts/ds_report'
2024-08-19T05:37:22,500   adding 'deepspeed-0.14.5.data/scripts/ds_ssh'
2024-08-19T05:37:22,501   adding 'deepspeed-0.14.5.data/scripts/dsr'
2024-08-19T05:37:22,504   adding 'deepspeed-0.14.5.dist-info/LICENSE'
2024-08-19T05:37:22,509   adding 'deepspeed-0.14.5.dist-info/METADATA'
2024-08-19T05:37:22,510   adding 'deepspeed-0.14.5.dist-info/WHEEL'
2024-08-19T05:37:22,511   adding 'deepspeed-0.14.5.dist-info/entry_points.txt'
2024-08-19T05:37:22,512   adding 'deepspeed-0.14.5.dist-info/top_level.txt'
2024-08-19T05:37:22,525   adding 'deepspeed-0.14.5.dist-info/RECORD'
2024-08-19T05:37:22,550   removing build/bdist.linux-armv7l/wheel
2024-08-19T05:37:22,773   deepspeed build time = 10.819112300872803 secs
2024-08-19T05:37:22,898   Building wheel for deepspeed (setup.py): finished with status 'done'
2024-08-19T05:37:22,915   Created wheel for deepspeed: filename=deepspeed-0.14.5-py3-none-any.whl size=1468704 sha256=263ffcc1021063d10dbaa5b00c96b2345ea8f38b15193d5269b5db2af7732f6e
2024-08-19T05:37:22,917   Stored in directory: /tmp/pip-ephem-wheel-cache-5rli304y/wheels/56/4e/3b/4d694b3fef4757846a27ea163fe304686e43de7bae2cdf8c37
2024-08-19T05:37:22,958 Successfully built deepspeed
2024-08-19T05:37:23,014 Removed build tracker: '/tmp/pip-build-tracker-3q1bnmao'