2023-11-23T10:46:51,343 Created temporary directory: /tmp/pip-build-tracker-hqla73jn 2023-11-23T10:46:51,345 Initialized build tracking at /tmp/pip-build-tracker-hqla73jn 2023-11-23T10:46:51,345 Created build tracker: /tmp/pip-build-tracker-hqla73jn 2023-11-23T10:46:51,346 Entered build tracker: /tmp/pip-build-tracker-hqla73jn 2023-11-23T10:46:51,346 Created temporary directory: /tmp/pip-wheel-up19b07r 2023-11-23T10:46:51,349 Created temporary directory: /tmp/pip-ephem-wheel-cache-fi6jm4wo 2023-11-23T10:46:51,371 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-11-23T10:46:51,375 2 location(s) to search for versions of deepspeed: 2023-11-23T10:46:51,375 * https://pypi.org/simple/deepspeed/ 2023-11-23T10:46:51,375 * https://www.piwheels.org/simple/deepspeed/ 2023-11-23T10:46:51,376 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2023-11-23T10:46:51,377 Getting page https://pypi.org/simple/deepspeed/ 2023-11-23T10:46:51,378 Found index url https://pypi.org/simple/ 2023-11-23T10:46:51,595 Fetched page https://pypi.org/simple/deepspeed/ as application/vnd.pypi.simple.v1+json 2023-11-23T10:46:51,610 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-23T10:46:51,610 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2023-11-23T10:46:51,611 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-23T10:46:51,612 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2023-11-23T10:46:51,612 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-23T10:46:51,613 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2023-11-23T10:46:51,614 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-23T10:46:51,614 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2023-11-23T10:46:51,615 Skipping link: No binaries permitted for deepspeed: https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl (from https://pypi.org/simple/deepspeed/) 2023-11-23T10:46:51,616 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2023-11-23T10:46:51,616 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2023-11-23T10:46:51,617 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2023-11-23T10:46:51,618 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2023-11-23T10:46:51,619 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2023-11-23T10:46:51,619 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2023-11-23T10:46:51,620 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2023-11-23T10:46:51,621 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2023-11-23T10:46:51,621 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2023-11-23T10:46:51,622 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2023-11-23T10:46:51,622 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2023-11-23T10:46:51,623 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2023-11-23T10:46:51,624 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2023-11-23T10:46:51,624 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2023-11-23T10:46:51,625 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2023-11-23T10:46:51,626 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2023-11-23T10:46:51,626 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2023-11-23T10:46:51,627 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2023-11-23T10:46:51,628 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2023-11-23T10:46:51,629 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2023-11-23T10:46:51,629 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2023-11-23T10:46:51,630 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2023-11-23T10:46:51,631 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2023-11-23T10:46:51,632 Found link https://files.pythonhosted.org/packages/c5/f5/4c33e7f0af90e3f7a0719ef02167712914854f8cffe1bc2d4f82b20e213d/deepspeed-0.4.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.3 2023-11-23T10:46:51,632 Found link https://files.pythonhosted.org/packages/5f/6b/fe90f88b48d33489d3bd5aab98f56c01729feaa863e2b6a503fa95a733fa/deepspeed-0.4.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.4 2023-11-23T10:46:51,633 Found link https://files.pythonhosted.org/packages/aa/b4/1823122b60a2d8c8120454d45edddb5d26bd548324b7d7f24b9e81d56fb8/deepspeed-0.4.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.4.5 2023-11-23T10:46:51,633 Found link https://files.pythonhosted.org/packages/9f/91/7c005637e5d74880a8cab090723e22b4ab55cb7969bbc7d365202acf4c15/deepspeed-0.5.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.0 2023-11-23T10:46:51,634 Found link https://files.pythonhosted.org/packages/ff/a7/989d8aab64366001a89bcaea549323ae8e3595961229347710d1f012a4a1/deepspeed-0.5.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.1 2023-11-23T10:46:51,634 Found link https://files.pythonhosted.org/packages/74/10/d6bbe4777b2c00c76ca0fa44a30c86c972382b86ca696653e7f13d586595/deepspeed-0.5.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.2 2023-11-23T10:46:51,635 Found link https://files.pythonhosted.org/packages/24/4c/82b5a68f2ecfc44ba1a5ecb00c6dcd414790a92f2c4be24d3b67044efded/deepspeed-0.5.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.3 2023-11-23T10:46:51,636 Found link https://files.pythonhosted.org/packages/71/d1/a5e34114648c8115c9912f73038106aa7d615215fafdd56c8d24eaba9f31/deepspeed-0.5.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.4 2023-11-23T10:46:51,636 Found link https://files.pythonhosted.org/packages/eb/3d/da5d2442166648636a5354248d868f5a0c1381f9e1a21ad7a1c9a39b0604/deepspeed-0.5.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.5 2023-11-23T10:46:51,637 Found link https://files.pythonhosted.org/packages/83/46/2fcf2720dd893b08fe5597299ffc26ac5be14ebae7a3ad3a19b2bb3ebc9d/deepspeed-0.5.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.6 2023-11-23T10:46:51,638 Found link https://files.pythonhosted.org/packages/3f/03/98116ff6d6cd87d0abcc22054f987980d663fcb8e5749cbd18e42c2e478b/deepspeed-0.5.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.7 2023-11-23T10:46:51,638 Found link https://files.pythonhosted.org/packages/c3/95/0779a42718bd3b27e756a58afe90565a848715343db9a563c2e703f6d821/deepspeed-0.5.8.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.8 2023-11-23T10:46:51,639 Found link https://files.pythonhosted.org/packages/12/ec/3839b145be0a5a5044355bedaf059e1aa00ae284a92a9510ddab70c4bdeb/deepspeed-0.5.9.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.9 2023-11-23T10:46:51,640 Found link https://files.pythonhosted.org/packages/8e/2c/c899ebb4b5c9b36d76f6bf527cee385869b3de23816b34ab9a2f6ab7afcc/deepspeed-0.5.10.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.5.10 2023-11-23T10:46:51,641 Found link https://files.pythonhosted.org/packages/53/8d/c4de44b359205f2203bde2a83769d3926b16d26fa87b89e027ead78b9e6a/deepspeed-0.6.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.0 2023-11-23T10:46:51,641 Found link https://files.pythonhosted.org/packages/4a/39/177c59ef1114e8518aa6f9880b67f656d2e73e91b3a23734de43c6a11f75/deepspeed-0.6.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.1 2023-11-23T10:46:51,642 Found link https://files.pythonhosted.org/packages/50/e6/36e928da40cb2b5a978371ff245e220dcfc7ee963abdbd2acfc8f2717341/deepspeed-0.6.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.3 2023-11-23T10:46:51,643 Found link https://files.pythonhosted.org/packages/5c/d1/2380f40b7f3f72974130406ec0f758408fda491e156441f126c19f23f13d/deepspeed-0.6.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.4 2023-11-23T10:46:51,644 Found link https://files.pythonhosted.org/packages/12/6c/35599340edea9a66552aec19490cc433822d4c86ccc8bc196090e301674f/deepspeed-0.6.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.5 2023-11-23T10:46:51,644 Found link https://files.pythonhosted.org/packages/ea/0b/0548359bf1d9484cdc0c250037acb7925eb6eb290f6ee20900eefbb551a0/deepspeed-0.6.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.6 2023-11-23T10:46:51,645 Found link https://files.pythonhosted.org/packages/3d/ab/f6f8c5972beead753aba767fb10c39d41de141bef71d4c783479158ec85c/deepspeed-0.6.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.6.7 2023-11-23T10:46:51,645 Found link https://files.pythonhosted.org/packages/ea/07/1208b14565915291caab3557f3c6427701c08a06acab173ae830c68bd770/deepspeed-0.7.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.0 2023-11-23T10:46:51,646 Found link https://files.pythonhosted.org/packages/96/29/8ca1e1f6a855459cbbb0c4a10f1d685d3b19535a8ad30d54d51b4739425a/deepspeed-0.7.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.1 2023-11-23T10:46:51,647 Found link https://files.pythonhosted.org/packages/2a/66/3cd92515f3167fb09f6b649e9cea0a571b0bf2997c6d1d377c987e953d57/deepspeed-0.7.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.2 2023-11-23T10:46:51,647 Found link https://files.pythonhosted.org/packages/3e/55/b96156249b18f640ff7d82f51159b68fd0cb158f3dc053d4c1449f02f24a/deepspeed-0.7.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.3 2023-11-23T10:46:51,648 Found link https://files.pythonhosted.org/packages/57/6f/d9991905bce9d2e90ea496c067c83e1bc45c01e007c793c80cd16e97a426/deepspeed-0.7.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.4 2023-11-23T10:46:51,649 Found link https://files.pythonhosted.org/packages/54/7a/953bc9ad0d4e61295b4ed3a738facf6270082b05cbd2a9bfd4619f11bb61/deepspeed-0.7.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.5 2023-11-23T10:46:51,650 Found link https://files.pythonhosted.org/packages/8c/6c/ea4d7f94208cc096167bf8a47428db1f21bf47d6cecf31513687485122b8/deepspeed-0.7.6.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.6 2023-11-23T10:46:51,650 Found link https://files.pythonhosted.org/packages/f4/10/77e723fda95fb2747d66beea8c171fb50fd0e00fb56f4e8eed25184e7fed/deepspeed-0.7.7.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.7.7 2023-11-23T10:46:51,651 Found link https://files.pythonhosted.org/packages/0d/6a/216004220f0658ac4ee2c06f724b1557d1a5f0533f7fd0830845351d0b30/deepspeed-0.8.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.0 2023-11-23T10:46:51,652 Found link https://files.pythonhosted.org/packages/76/88/52bb9a6df9dcebf611588632ee63eda7de342df011fd671dd2f48deb8727/deepspeed-0.8.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.1 2023-11-23T10:46:51,652 Found link https://files.pythonhosted.org/packages/b4/7f/f81e601329fd19c5e7beabb472e0a4cb1ede8292b10df715b261f4d3a16b/deepspeed-0.8.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.2 2023-11-23T10:46:51,653 Found link https://files.pythonhosted.org/packages/0f/c0/9b57e9ec56f6f405726a384b109f8da1267e41feea081850c2fce1735712/deepspeed-0.8.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.8.3 2023-11-23T10:46:51,654 Found link https://files.pythonhosted.org/packages/fb/68/99dd7c647aeb1c7e2af16c7fc23a3ca5891fc6e0b2438f730aeaf6ff06f4/deepspeed-0.9.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.0 2023-11-23T10:46:51,654 Found link https://files.pythonhosted.org/packages/fc/4e/5eb2fd0f363b89e8f58673fb4a9bd04b8273a43e4e7aa3d397ed76b1ca63/deepspeed-0.9.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.1 2023-11-23T10:46:51,655 Found link https://files.pythonhosted.org/packages/9e/6a/ce4e9afcf36f242f55bf2c91fa1366b26f0f40653d98a96c0f64b7154c12/deepspeed-0.9.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.2 2023-11-23T10:46:51,656 Found link https://files.pythonhosted.org/packages/9f/64/4a3643f61b15dbfec1cab0172f4bdae1d45e1ab3cd73bb0600978d5e4e5a/deepspeed-0.9.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.3 2023-11-23T10:46:51,657 Found link https://files.pythonhosted.org/packages/41/04/14787d6ce94a70fa2a4e6b123d6c1fec7317d8249ac26176932316ff1153/deepspeed-0.9.4.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.4 2023-11-23T10:46:51,657 Found link https://files.pythonhosted.org/packages/99/0f/a4ebd3b3f6a8fd9bca77ca5f570724f3902ca90b491f8146e45c9733e64f/deepspeed-0.9.5.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.9.5 2023-11-23T10:46:51,658 Found link https://files.pythonhosted.org/packages/c5/1d/74dde2835ac5087cf5727e73b8868299d863910947988ddca986443f714a/deepspeed-0.10.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.0 2023-11-23T10:46:51,658 Found link https://files.pythonhosted.org/packages/a9/4f/d37d2f0bd05f4504370eb0a763c0dbdba12ad12daeb3104c00ac416faeac/deepspeed-0.10.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.1 2023-11-23T10:46:51,659 Found link https://files.pythonhosted.org/packages/73/f2/c6760ca21855ff8a0a787dc9943e0a15c833db0eefb424f9af8703668a64/deepspeed-0.10.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.2 2023-11-23T10:46:51,659 Found link https://files.pythonhosted.org/packages/82/75/04ee6511c2b54971bf73d25e0d300e149c381c49e43221806289cacd8d8a/deepspeed-0.10.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.10.3 2023-11-23T10:46:51,660 Found link https://files.pythonhosted.org/packages/06/54/7c7c3a8e6272f5abad04a3fe94a85530dcdc1bc91a1b63c11c04c0451ab8/deepspeed-0.11.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.0 2023-11-23T10:46:51,660 Found link https://files.pythonhosted.org/packages/73/11/14f424b21eddaf2c339e0c149ec0a11159ab5eb7340303d311ddb47e9689/deepspeed-0.11.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.1 2023-11-23T10:46:51,661 Found link https://files.pythonhosted.org/packages/84/4c/6e6181a29b3bc5b64e365a94aa230c2fa2bd18719c2153be0299dbcfff71/deepspeed-0.11.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.11.2 2023-11-23T10:46:51,662 Found link https://files.pythonhosted.org/packages/92/ec/21f9cc7ac0de28ad6bb88d25740e7ab616c54132e9909189c8f8f3853efe/deepspeed-0.12.0.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.0 2023-11-23T10:46:51,662 Found link https://files.pythonhosted.org/packages/3e/16/2740f0c7c801b2348f82782bea52bfba655bf8360a573375e4ef76a00260/deepspeed-0.12.1.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.1 2023-11-23T10:46:51,663 Found link https://files.pythonhosted.org/packages/f5/74/2b7de743230ffa0fb25b3ee88730528938499138a624d0c178ec357ce467/deepspeed-0.12.2.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.2 2023-11-23T10:46:51,664 Found link https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz (from https://pypi.org/simple/deepspeed/), version: 0.12.3 2023-11-23T10:46:51,665 Fetching project page and analyzing links: https://www.piwheels.org/simple/deepspeed/ 2023-11-23T10:46:51,665 Getting page https://www.piwheels.org/simple/deepspeed/ 2023-11-23T10:46:51,667 Found index url https://www.piwheels.org/simple/ 2023-11-23T10:46:51,867 Fetched page https://www.piwheels.org/simple/deepspeed/ as text/html 2023-11-23T10:46:51,880 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.2-py3-none-any.whl#sha256=b64510574ac56608b70fc5db2e8086c91b3bd60679fcb3731940b4c84996dd19 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,881 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.1-py3-none-any.whl#sha256=15edd4a0742e6f191f82f194c3959ad854267c0e2d69c7fffe6b998b0159a92c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,882 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.12.0-py3-none-any.whl#sha256=d5d4811130ef9f9b3a5942237d12aa2168fbfb0fd63bcb57bf428cd872ab6677 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,882 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.2-py3-none-any.whl#sha256=5d1c5e55b4dc42485a4284a632ca111b6d07530f660293d4accc64120b6e2f6c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,883 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.11.1-py3-none-any.whl#sha256=1781c04e98fd7444abc1b65b21218d273daebcfbededf68084fc7a13f7e716ba (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,884 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.3-py3-none-any.whl#sha256=9d0352a4a37d4ef0113713402cb81b344a23c261d37dbd6334b9170e79d6a03c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,884 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.2-py3-none-any.whl#sha256=14f4837844edd9ff0fbdd2cf4b3d828a78acd836d57bf6363958b897eae3c375 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,885 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.1-py3-none-any.whl#sha256=af9b4b37088f89c42237ba1ce97627edd9d5f77fef6af0fdb9097adbd65995e5 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,885 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.10.0-py3-none-any.whl#sha256=74a73c43ac6a879b91526a94ae408ef1033e1a398168b24f145d32706f79004c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,886 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.5-py3-none-any.whl#sha256=f3af2e36d0056a75c7d08fde95f534925277dc0c634711cfd170a1d4b09451fe (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,887 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.4-py3-none-any.whl#sha256=246cd8ef0b616a9b48ae0000b08fdc01cf43659f2a2741c6200bf7d38d6ac8e1 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,887 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.3-py3-none-any.whl#sha256=05f09e3da0741b1c82dfbb14191775c25f58c037e907c052a65973ecf86ff752 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,888 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.2-py3-none-any.whl#sha256=e111989a2e6d43b70f28c8991acc820560aeb6ce9b6ac9fd35b9a87ed9554213 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,888 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.1-py3-none-any.whl#sha256=55146e460e317103c7b5b0c8b4005eb5b3b110b80cb16fcf3af78620367b1c29 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,889 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.9.0-py3-none-any.whl#sha256=f1665e4eb6815f573ba34a45d2b276e153cf446aefe39538af01d14539154e13 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,890 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.3-py3-none-any.whl#sha256=4ba43426826930d4983557fb058ddd464658e0da051faf0bd921caaf454a7398 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,890 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.2-py3-none-any.whl#sha256=1f2a0a4ff0ce296695e8318d1ab13ac4d7409dfc657536022d5d659f09d62d9e (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,891 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.1-py3-none-any.whl#sha256=ab51ff1b3d40790240b04980a76fe9bdd73e9fac5a12e78aea7450503c9079ad (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,891 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.8.0-py3-none-any.whl#sha256=26b4f6af7f62fae935613f982e240dcbbb64ebd27f37bcee21bb965352a0be86 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,892 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.7-py3-none-any.whl#sha256=3eb63dcb21b82bf9163ab34bc30e225289213e96b5b3c49062804ad7bbf2f264 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,893 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.6-py3-none-any.whl#sha256=a47f1c28be8b1734cd36461c2add47c103ad0225d293683382f3d027ea2fad7c (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,893 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.5-py3-none-any.whl#sha256=0238e1223fb291933653d1f8dcd5b04ef11106228298282c8e6365e91a21de61 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,893 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.4-py3-none-any.whl#sha256=bcba8b95ee33ce2a068cffcc9704cf99917b6c8d2b142d8ea4fac985f969b3fd (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,894 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.3-py3-none-any.whl#sha256=7490bc96f7c907fa6fb36fc085f583814fe7d07afa419b9245f774a04b3c670b (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,894 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.2-py3-none-any.whl#sha256=98889dedec99e445f2e248989bba541e3d2d66ba6f2c2ea34946aa5b26e7fdcb (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,895 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.7.1-py3-none-any.whl#sha256=e4d19a9f0f3741ecdec615aa4484314d6be4f168e498b321a531c540d754f704 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,896 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.7-py3-none-any.whl#sha256=2221d297819febe22e7114e9e77c2b0f775292490e17304c1f61c5202348c835 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,896 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.6-py3-none-any.whl#sha256=0fd2f6e72d04baee2c2be533d69aaa3d0438ef08fc21d5f176dee4b9edc13ed8 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,897 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.5-py3-none-any.whl#sha256=1422412caa391c8fc01a624c196cfaa4c722cea64941857fbc2d9d3236057076 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,897 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.4-py3-none-any.whl#sha256=6a8aec151934580ea18a5b00e7a3d24ab6048a9e7f11003e5dfbffb6b523bf00 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,898 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.6.3-py3-none-any.whl#sha256=93a4967a9d81b442e4254411ced7802293b8bf298f175639660c91b03b1c56a4 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,899 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.10-py3-none-any.whl#sha256=857c567616d438490ec40839c69d05aea87faef09afe80099c857c910ff673db (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,899 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.9-py3-none-any.whl#sha256=f1c2971d51d82e055c4051aec7705741d22c872667e645f19de49df2e009c33e (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,900 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.8-py3-none-any.whl#sha256=57eee88892c53d3b1bbafac2615c1a42e0313e32681b1cfdcbed747173933abf (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,900 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.7-py3-none-any.whl#sha256=7b14bc8421a17a16850d3c4a33253bc980e7fc9fbbe9fcd5be8e114aff128a1f (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,901 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.6-py3-none-any.whl#sha256=b3adaaf52d625c406eec3133517936aaebc2b4930e81d294dca0d964b82a4ef1 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,901 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.5-py3-none-any.whl#sha256=10f4f20e130a5b23d5c83781ac0752cd0bce456555eea98e0a988109e79c9114 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,902 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.4-py3-none-any.whl#sha256=e64cd4fbd9c55eb7fe096bc02fa52033715960bca7354f78c59a85363be429e6 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,902 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.3-py3-none-any.whl#sha256=6bb0d5421a6db3f7e336c130bc7d8363e8018e861e6f3c2857e3d8b0c428ee60 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,903 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.2-py3-none-any.whl#sha256=30bdf23a69d397e3fa11d6b545b63653dd13bed8eab1ea9035b8ccd1b2c11f06 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,903 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.1-py3-none-any.whl#sha256=c81dcf23a26df34e29a235cbfc3fbf4b373d539a767a567a36db7093302447ce (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,904 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.5.0-py3-none-any.whl#sha256=47dd2bffd4fa888c9f91fb9c9c560e31d1ee7796dc64c37880ad5deea491fdd4 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,904 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.5-py3-none-any.whl#sha256=201f5dd049e28f73278eca183be0993f3b8aa93dbe8cfdcd0d2cb476739ce008 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,905 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.4-py3-none-any.whl#sha256=6f24c155617ba8fae22183c2735cd13ca6fc2bd97517a20f35f40384ae756584 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,905 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.3-py3-none-any.whl#sha256=fad5cfa13c1d478f1e6fe025298e130ec093553ab5da57d84568ee003542de59 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,906 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.2-py3-none-any.whl#sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,906 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.4.1-py3-none-any.whl#sha256=053f688ee233c9829812821bd1123d26f45325c7964acd7d40dce13344832575 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,907 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,908 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,908 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,909 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,909 Skipping link: No binaries permitted for deepspeed: https://www.piwheels.org/simple/deepspeed/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://www.piwheels.org/simple/deepspeed/) 2023-11-23T10:46:51,910 Skipping link: not a file: https://www.piwheels.org/simple/deepspeed/ 2023-11-23T10:46:51,910 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2023-11-23T10:46:51,939 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2023-11-23T10:46:51,959 Collecting deepspeed==0.12.3 2023-11-23T10:46:51,961 Created temporary directory: /tmp/pip-unpack-xv5f1bt1 2023-11-23T10:46:52,101 Downloading deepspeed-0.12.3.tar.gz (1.2 MB) 2023-11-23T10:46:54,050 Added deepspeed==0.12.3 from https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz to build tracker '/tmp/pip-build-tracker-hqla73jn' 2023-11-23T10:46:54,052 Running setup.py (path:/tmp/pip-wheel-up19b07r/deepspeed_a86947037b604cc699376d34518b40f2/setup.py) egg_info for package deepspeed 2023-11-23T10:46:54,053 Created temporary directory: /tmp/pip-pip-egg-info-b6p32d_a 2023-11-23T10:46:54,053 Preparing metadata (setup.py): started 2023-11-23T10:46:54,055 Running command python setup.py egg_info 2023-11-23T10:46:54,912 fatal: not a git repository (or any of the parent directories): .git 2023-11-23T10:46:55,578 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-11-23T10:46:55,579  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-11-23T10:46:55,580 DS_BUILD_OPS=0 2023-11-23T10:46:55,580  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-11-23T10:46:55,581  [WARNING]  async_io: please install the libaio-dev package with apt 2023-11-23T10:46:55,581  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-11-23T10:46:55,582  [WARNING]  Please install torch if trying to pre-compile kernels 2023-11-23T10:46:55,582  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:55,583  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:55,584  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:55,585  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:55,585  [WARNING]  unable to import torch, please install it first 2023-11-23T10:46:55,585  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:55,586  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:55,586 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-11-23T10:46:55,587 version=0.12.3, git_hash=unknown, git_branch=unknown 2023-11-23T10:46:55,587 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-11-23T10:46:55,588 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-11-23T10:46:55,589 ext_modules=[] 2023-11-23T10:46:55,589 running egg_info 2023-11-23T10:46:55,590 creating /tmp/pip-pip-egg-info-b6p32d_a/deepspeed.egg-info 2023-11-23T10:46:55,611 writing /tmp/pip-pip-egg-info-b6p32d_a/deepspeed.egg-info/PKG-INFO 2023-11-23T10:46:55,643 writing dependency_links to /tmp/pip-pip-egg-info-b6p32d_a/deepspeed.egg-info/dependency_links.txt 2023-11-23T10:46:55,645 writing entry points to /tmp/pip-pip-egg-info-b6p32d_a/deepspeed.egg-info/entry_points.txt 2023-11-23T10:46:55,661 writing requirements to /tmp/pip-pip-egg-info-b6p32d_a/deepspeed.egg-info/requires.txt 2023-11-23T10:46:55,662 writing top-level names to /tmp/pip-pip-egg-info-b6p32d_a/deepspeed.egg-info/top_level.txt 2023-11-23T10:46:55,665 writing manifest file '/tmp/pip-pip-egg-info-b6p32d_a/deepspeed.egg-info/SOURCES.txt' 2023-11-23T10:46:55,826 reading manifest file '/tmp/pip-pip-egg-info-b6p32d_a/deepspeed.egg-info/SOURCES.txt' 2023-11-23T10:46:55,828 reading manifest template 'MANIFEST.in' 2023-11-23T10:46:55,830 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-11-23T10:46:55,831 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-11-23T10:46:56,857 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-11-23T10:46:57,667 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-11-23T10:46:58,122 warning: no files found matching '*.tr' under directory 'csrc' 2023-11-23T10:46:58,214 warning: no files found matching '*.cc' under directory 'csrc' 2023-11-23T10:46:58,239 warning: no files found matching '*.py' under directory 'benchmarks' 2023-11-23T10:46:58,272 writing manifest file '/tmp/pip-pip-egg-info-b6p32d_a/deepspeed.egg-info/SOURCES.txt' 2023-11-23T10:46:58,274 deepspeed build time = 3.3592512607574463 secs 2023-11-23T10:46:58,389 Preparing metadata (setup.py): finished with status 'done' 2023-11-23T10:46:58,395 Source in /tmp/pip-wheel-up19b07r/deepspeed_a86947037b604cc699376d34518b40f2 has version 0.12.3, which satisfies requirement deepspeed==0.12.3 from https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz 2023-11-23T10:46:58,396 Removed deepspeed==0.12.3 from https://files.pythonhosted.org/packages/61/e6/04e2f2de08253e6b779fe7706f2e06d8fb48353e1d33a2fd7805062213d4/deepspeed-0.12.3.tar.gz from build tracker '/tmp/pip-build-tracker-hqla73jn' 2023-11-23T10:46:58,405 Created temporary directory: /tmp/pip-unpack-banls6w8 2023-11-23T10:46:58,406 Created temporary directory: /tmp/pip-unpack-rer9j4uw 2023-11-23T10:46:58,646 Building wheels for collected packages: deepspeed 2023-11-23T10:46:58,650 Created temporary directory: /tmp/pip-wheel-n2mmkk6o 2023-11-23T10:46:58,650 Building wheel for deepspeed (setup.py): started 2023-11-23T10:46:58,651 Destination directory: /tmp/pip-wheel-n2mmkk6o 2023-11-23T10:46:58,652 Running command python setup.py bdist_wheel 2023-11-23T10:46:59,090 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2023-11-23T10:46:59,100  [WARNING]  unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2023-11-23T10:46:59,163 DS_BUILD_OPS=0 2023-11-23T10:46:59,275  [WARNING]  async_io requires the dev libaio .so object and headers but these were not found. 2023-11-23T10:46:59,333  [WARNING]  async_io: please install the libaio-dev package with apt 2023-11-23T10:46:59,333  [WARNING]  If libaio is already installed (perhaps from source), try setting the CFLAGS and LDFLAGS environment variables to where it can be found. 2023-11-23T10:46:59,334  [WARNING]  Please install torch if trying to pre-compile kernels 2023-11-23T10:46:59,334  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:59,335  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:59,336  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:59,336  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:59,337  [WARNING]  unable to import torch, please install it first 2023-11-23T10:46:59,338  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:59,338  [WARNING]  Please install torch if trying to pre-compile inference kernels 2023-11-23T10:46:59,339 Install Ops={'async_io': False, 'fused_adam': False, 'cpu_adam': False, 'cpu_adagrad': False, 'cpu_lion': False, 'evoformer_attn': False, 'fused_lamb': False, 'fused_lion': False, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': False, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': False, 'sparse_attn': False, 'spatial_inference': False, 'transformer': False, 'stochastic_transformer': False, 'transformer_inference': False} 2023-11-23T10:46:59,347 fatal: not a git repository (or any of the parent directories): .git 2023-11-23T10:46:59,348 version=0.12.3, git_hash=unknown, git_branch=unknown 2023-11-23T10:46:59,349 install_requires=['hjson', 'ninja', 'numpy', 'packaging>=20.0', 'psutil', 'py-cpuinfo', 'pydantic', 'pynvml', 'torch', 'tqdm'] 2023-11-23T10:46:59,350 compatible_ops={'async_io': False, 'fused_adam': True, 'cpu_adam': True, 'cpu_adagrad': True, 'cpu_lion': True, 'evoformer_attn': False, 'fused_lamb': True, 'fused_lion': True, 'inference_core_ops': False, 'cutlass_ops': False, 'quantizer': True, 'ragged_device_ops': False, 'ragged_ops': False, 'random_ltd': True, 'sparse_attn': False, 'spatial_inference': False, 'transformer': True, 'stochastic_transformer': True, 'transformer_inference': False, 'deepspeed_not_implemented': False} 2023-11-23T10:46:59,350 ext_modules=[] 2023-11-23T10:46:59,978 running bdist_wheel 2023-11-23T10:47:00,079 running build 2023-11-23T10:47:00,080 running build_py 2023-11-23T10:47:00,109 creating build 2023-11-23T10:47:00,109 creating build/lib 2023-11-23T10:47:00,110 creating build/lib/deepspeed 2023-11-23T10:47:00,112 copying deepspeed/constants.py -> build/lib/deepspeed 2023-11-23T10:47:00,114 copying deepspeed/__init__.py -> build/lib/deepspeed 2023-11-23T10:47:00,116 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2023-11-23T10:47:00,118 copying deepspeed/env_report.py -> build/lib/deepspeed 2023-11-23T10:47:00,121 copying deepspeed/pydantic_v1.py -> build/lib/deepspeed 2023-11-23T10:47:00,123 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2023-11-23T10:47:00,125 creating build/lib/deepspeed/inference 2023-11-23T10:47:00,126 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2023-11-23T10:47:00,128 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2023-11-23T10:47:00,131 copying deepspeed/inference/config.py -> build/lib/deepspeed/inference 2023-11-23T10:47:00,134 creating build/lib/deepspeed/monitor 2023-11-23T10:47:00,135 copying deepspeed/monitor/__init__.py -> build/lib/deepspeed/monitor 2023-11-23T10:47:00,138 copying deepspeed/monitor/wandb.py -> build/lib/deepspeed/monitor 2023-11-23T10:47:00,140 copying deepspeed/monitor/utils.py -> build/lib/deepspeed/monitor 2023-11-23T10:47:00,141 copying deepspeed/monitor/monitor.py -> build/lib/deepspeed/monitor 2023-11-23T10:47:00,143 copying deepspeed/monitor/csv_monitor.py -> build/lib/deepspeed/monitor 2023-11-23T10:47:00,145 copying deepspeed/monitor/config.py -> build/lib/deepspeed/monitor 2023-11-23T10:47:00,147 copying deepspeed/monitor/tensorboard.py -> build/lib/deepspeed/monitor 2023-11-23T10:47:00,150 creating build/lib/deepspeed/moe 2023-11-23T10:47:00,151 copying deepspeed/moe/__init__.py -> build/lib/deepspeed/moe 2023-11-23T10:47:00,153 copying deepspeed/moe/layer.py -> build/lib/deepspeed/moe 2023-11-23T10:47:00,156 copying deepspeed/moe/mappings.py -> build/lib/deepspeed/moe 2023-11-23T10:47:00,157 copying deepspeed/moe/utils.py -> build/lib/deepspeed/moe 2023-11-23T10:47:00,160 copying deepspeed/moe/sharded_moe.py -> build/lib/deepspeed/moe 2023-11-23T10:47:00,163 copying deepspeed/moe/experts.py -> build/lib/deepspeed/moe 2023-11-23T10:47:00,165 creating build/lib/deepspeed/sequence 2023-11-23T10:47:00,166 copying deepspeed/sequence/__init__.py -> build/lib/deepspeed/sequence 2023-11-23T10:47:00,168 copying deepspeed/sequence/layer.py -> build/lib/deepspeed/sequence 2023-11-23T10:47:00,171 creating build/lib/deepspeed/autotuning 2023-11-23T10:47:00,172 copying deepspeed/autotuning/constants.py -> build/lib/deepspeed/autotuning 2023-11-23T10:47:00,174 copying deepspeed/autotuning/__init__.py -> build/lib/deepspeed/autotuning 2023-11-23T10:47:00,176 copying deepspeed/autotuning/autotuner.py -> build/lib/deepspeed/autotuning 2023-11-23T10:47:00,179 copying deepspeed/autotuning/utils.py -> build/lib/deepspeed/autotuning 2023-11-23T10:47:00,182 copying deepspeed/autotuning/scheduler.py -> build/lib/deepspeed/autotuning 2023-11-23T10:47:00,185 copying deepspeed/autotuning/config.py -> build/lib/deepspeed/autotuning 2023-11-23T10:47:00,188 creating build/lib/deepspeed/launcher 2023-11-23T10:47:00,189 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2023-11-23T10:47:00,191 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2023-11-23T10:47:00,193 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2023-11-23T10:47:00,196 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2023-11-23T10:47:00,198 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2023-11-23T10:47:00,201 creating build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,202 copying deepspeed/checkpoint/constants.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,205 copying deepspeed/checkpoint/__init__.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,207 copying deepspeed/checkpoint/reshape_utils.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,209 copying deepspeed/checkpoint/ds_to_universal.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,212 copying deepspeed/checkpoint/reshape_meg_2d.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,214 copying deepspeed/checkpoint/utils.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,216 copying deepspeed/checkpoint/deepspeed_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,218 copying deepspeed/checkpoint/zero_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,220 copying deepspeed/checkpoint/universal_checkpoint.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,223 copying deepspeed/checkpoint/reshape_3d_utils.py -> build/lib/deepspeed/checkpoint 2023-11-23T10:47:00,225 creating build/lib/deepspeed/compression 2023-11-23T10:47:00,226 copying deepspeed/compression/constants.py -> build/lib/deepspeed/compression 2023-11-23T10:47:00,229 copying deepspeed/compression/__init__.py -> build/lib/deepspeed/compression 2023-11-23T10:47:00,231 copying deepspeed/compression/utils.py -> build/lib/deepspeed/compression 2023-11-23T10:47:00,233 copying deepspeed/compression/scheduler.py -> build/lib/deepspeed/compression 2023-11-23T10:47:00,236 copying deepspeed/compression/compress.py -> build/lib/deepspeed/compression 2023-11-23T10:47:00,238 copying deepspeed/compression/basic_layer.py -> build/lib/deepspeed/compression 2023-11-23T10:47:00,241 copying deepspeed/compression/config.py -> build/lib/deepspeed/compression 2023-11-23T10:47:00,243 copying deepspeed/compression/helper.py -> build/lib/deepspeed/compression 2023-11-23T10:47:00,246 creating build/lib/deepspeed/accelerator 2023-11-23T10:47:00,247 copying deepspeed/accelerator/__init__.py -> build/lib/deepspeed/accelerator 2023-11-23T10:47:00,249 copying deepspeed/accelerator/npu_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-23T10:47:00,252 copying deepspeed/accelerator/real_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-23T10:47:00,254 copying deepspeed/accelerator/cpu_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-23T10:47:00,256 copying deepspeed/accelerator/cuda_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-23T10:47:00,259 copying deepspeed/accelerator/abstract_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-23T10:47:00,261 copying deepspeed/accelerator/mps_accelerator.py -> build/lib/deepspeed/accelerator 2023-11-23T10:47:00,264 creating build/lib/deepspeed/model_implementations 2023-11-23T10:47:00,265 copying deepspeed/model_implementations/__init__.py -> build/lib/deepspeed/model_implementations 2023-11-23T10:47:00,268 creating build/lib/deepspeed/utils 2023-11-23T10:47:00,269 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,271 copying deepspeed/utils/init_on_device.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,273 copying deepspeed/utils/tensor_fragment.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,275 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,278 copying deepspeed/utils/nvtx.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,280 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,282 copying deepspeed/utils/comms_logging.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,284 copying deepspeed/utils/mixed_precision_linkage.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,286 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,289 copying deepspeed/utils/groups.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,291 copying deepspeed/utils/exceptions.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,294 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,296 copying deepspeed/utils/numa.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,299 copying deepspeed/utils/types.py -> build/lib/deepspeed/utils 2023-11-23T10:47:00,301 creating build/lib/deepspeed/ops 2023-11-23T10:47:00,302 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2023-11-23T10:47:00,305 creating build/lib/deepspeed/comm 2023-11-23T10:47:00,306 copying deepspeed/comm/constants.py -> build/lib/deepspeed/comm 2023-11-23T10:47:00,308 copying deepspeed/comm/comm.py -> build/lib/deepspeed/comm 2023-11-23T10:47:00,311 copying deepspeed/comm/__init__.py -> build/lib/deepspeed/comm 2023-11-23T10:47:00,313 copying deepspeed/comm/utils.py -> build/lib/deepspeed/comm 2023-11-23T10:47:00,315 copying deepspeed/comm/ccl.py -> build/lib/deepspeed/comm 2023-11-23T10:47:00,317 copying deepspeed/comm/reduce_op.py -> build/lib/deepspeed/comm 2023-11-23T10:47:00,319 copying deepspeed/comm/torch.py -> build/lib/deepspeed/comm 2023-11-23T10:47:00,321 copying deepspeed/comm/config.py -> build/lib/deepspeed/comm 2023-11-23T10:47:00,323 copying deepspeed/comm/backend.py -> build/lib/deepspeed/comm 2023-11-23T10:47:00,325 creating build/lib/deepspeed/module_inject 2023-11-23T10:47:00,326 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,328 copying deepspeed/module_inject/policy.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,330 copying deepspeed/module_inject/utils.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,331 copying deepspeed/module_inject/tp_shard.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,333 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,334 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,337 copying deepspeed/module_inject/fusedqkv_utils.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,339 copying deepspeed/module_inject/layers.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,341 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,344 copying deepspeed/module_inject/load_checkpoint.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,346 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,348 copying deepspeed/module_inject/auto_tp.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,351 copying deepspeed/module_inject/auto_tp_model_utils.py -> build/lib/deepspeed/module_inject 2023-11-23T10:47:00,354 creating build/lib/deepspeed/pipe 2023-11-23T10:47:00,355 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2023-11-23T10:47:00,358 creating build/lib/deepspeed/runtime 2023-11-23T10:47:00,359 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,362 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,364 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,367 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,370 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,372 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,375 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,379 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,382 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,385 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,387 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,393 copying deepspeed/runtime/hybrid_engine.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,397 copying deepspeed/runtime/bf16_optimizer.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,400 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,402 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,406 copying deepspeed/runtime/sparse_tensor.py -> build/lib/deepspeed/runtime 2023-11-23T10:47:00,409 creating build/lib/deepspeed/elasticity 2023-11-23T10:47:00,411 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2023-11-23T10:47:00,413 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2023-11-23T10:47:00,416 copying deepspeed/elasticity/utils.py -> build/lib/deepspeed/elasticity 2023-11-23T10:47:00,418 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2023-11-23T10:47:00,421 copying deepspeed/elasticity/elastic_agent.py -> build/lib/deepspeed/elasticity 2023-11-23T10:47:00,424 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2023-11-23T10:47:00,427 creating build/lib/deepspeed/profiling 2023-11-23T10:47:00,428 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2023-11-23T10:47:00,431 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2023-11-23T10:47:00,433 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2023-11-23T10:47:00,436 creating build/lib/deepspeed/nebula 2023-11-23T10:47:00,437 copying deepspeed/nebula/constants.py -> build/lib/deepspeed/nebula 2023-11-23T10:47:00,439 copying deepspeed/nebula/__init__.py -> build/lib/deepspeed/nebula 2023-11-23T10:47:00,442 copying deepspeed/nebula/config.py -> build/lib/deepspeed/nebula 2023-11-23T10:47:00,445 creating build/lib/deepspeed/inference/quantization 2023-11-23T10:47:00,446 copying deepspeed/inference/quantization/__init__.py -> build/lib/deepspeed/inference/quantization 2023-11-23T10:47:00,449 copying deepspeed/inference/quantization/utils.py -> build/lib/deepspeed/inference/quantization 2023-11-23T10:47:00,452 copying deepspeed/inference/quantization/quantization.py -> build/lib/deepspeed/inference/quantization 2023-11-23T10:47:00,454 copying deepspeed/inference/quantization/layers.py -> build/lib/deepspeed/inference/quantization 2023-11-23T10:47:00,457 copying deepspeed/inference/quantization/quantization_context.py -> build/lib/deepspeed/inference/quantization 2023-11-23T10:47:00,460 creating build/lib/deepspeed/inference/v2 2023-11-23T10:47:00,461 copying deepspeed/inference/v2/__init__.py -> build/lib/deepspeed/inference/v2 2023-11-23T10:47:00,464 copying deepspeed/inference/v2/logging.py -> build/lib/deepspeed/inference/v2 2023-11-23T10:47:00,466 copying deepspeed/inference/v2/scheduling_utils.py -> build/lib/deepspeed/inference/v2 2023-11-23T10:47:00,469 copying deepspeed/inference/v2/config_v2.py -> build/lib/deepspeed/inference/v2 2023-11-23T10:47:00,471 copying deepspeed/inference/v2/allocator.py -> build/lib/deepspeed/inference/v2 2023-11-23T10:47:00,474 copying deepspeed/inference/v2/inference_utils.py -> build/lib/deepspeed/inference/v2 2023-11-23T10:47:00,476 copying deepspeed/inference/v2/engine_v2.py -> build/lib/deepspeed/inference/v2 2023-11-23T10:47:00,479 copying deepspeed/inference/v2/engine_factory.py -> build/lib/deepspeed/inference/v2 2023-11-23T10:47:00,482 creating build/lib/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:00,483 copying deepspeed/inference/v2/checkpoint/__init__.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:00,485 copying deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:00,486 copying deepspeed/inference/v2/checkpoint/base_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:00,488 copying deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/lib/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:00,491 creating build/lib/deepspeed/inference/v2/ragged 2023-11-23T10:47:00,492 copying deepspeed/inference/v2/ragged/__init__.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-23T10:47:00,493 copying deepspeed/inference/v2/ragged/blocked_allocator.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-23T10:47:00,495 copying deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-23T10:47:00,497 copying deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-23T10:47:00,499 copying deepspeed/inference/v2/ragged/ragged_manager.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-23T10:47:00,501 copying deepspeed/inference/v2/ragged/kv_cache.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-23T10:47:00,503 copying deepspeed/inference/v2/ragged/manager_configs.py -> build/lib/deepspeed/inference/v2/ragged 2023-11-23T10:47:00,506 creating build/lib/deepspeed/inference/v2/kernels 2023-11-23T10:47:00,507 copying deepspeed/inference/v2/kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels 2023-11-23T10:47:00,508 copying deepspeed/inference/v2/kernels/ds_kernel.py -> build/lib/deepspeed/inference/v2/kernels 2023-11-23T10:47:00,510 creating build/lib/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:00,511 copying deepspeed/inference/v2/model_implementations/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:00,513 copying deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:00,515 copying deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:00,517 copying deepspeed/inference/v2/model_implementations/parameter_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:00,520 copying deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:00,522 copying deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/lib/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:00,524 creating build/lib/deepspeed/inference/v2/modules 2023-11-23T10:47:00,525 copying deepspeed/inference/v2/modules/__init__.py -> build/lib/deepspeed/inference/v2/modules 2023-11-23T10:47:00,527 copying deepspeed/inference/v2/modules/ds_module.py -> build/lib/deepspeed/inference/v2/modules 2023-11-23T10:47:00,529 copying deepspeed/inference/v2/modules/module_registry.py -> build/lib/deepspeed/inference/v2/modules 2023-11-23T10:47:00,530 copying deepspeed/inference/v2/modules/heuristics.py -> build/lib/deepspeed/inference/v2/modules 2023-11-23T10:47:00,533 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-23T10:47:00,534 copying deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-23T10:47:00,536 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-11-23T10:47:00,537 copying deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-11-23T10:47:00,539 creating build/lib/deepspeed/inference/v2/kernels/core_ops 2023-11-23T10:47:00,540 copying deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-11-23T10:47:00,542 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:00,543 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:00,545 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:00,547 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:00,548 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:00,550 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:00,551 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:00,554 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:00,555 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:00,556 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:00,558 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:00,559 copying deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:00,561 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:00,563 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:00,564 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:00,565 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:00,567 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:00,569 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:00,571 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:00,572 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:00,573 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:00,576 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:00,577 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:00,578 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:00,580 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:00,581 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:00,583 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:00,585 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:00,586 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:00,588 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:00,590 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:00,591 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:00,593 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:00,595 creating build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:00,596 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:00,597 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:00,599 creating build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:00,600 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:00,602 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:00,604 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:00,605 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:00,607 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:00,608 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:00,610 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:00,612 creating build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:00,613 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:00,614 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:00,616 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:00,618 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:00,620 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:00,622 creating build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:00,623 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:00,625 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:00,628 creating build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,629 copying deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,631 copying deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,633 copying deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,635 copying deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,637 copying deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,639 copying deepspeed/inference/v2/model_implementations/sharding/types.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,641 copying deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,643 copying deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,644 copying deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/lib/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:00,646 creating build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:00,647 copying deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:00,649 copying deepspeed/inference/v2/model_implementations/opt/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:00,650 copying deepspeed/inference/v2/model_implementations/opt/container.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:00,652 copying deepspeed/inference/v2/model_implementations/opt/model.py -> build/lib/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:00,654 creating build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:00,655 copying deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:00,657 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:00,659 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:00,661 copying deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/lib/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:00,663 creating build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:00,664 copying deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:00,666 copying deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:00,667 copying deepspeed/inference/v2/model_implementations/mistral/container.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:00,669 copying deepspeed/inference/v2/model_implementations/mistral/model.py -> build/lib/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:00,672 creating build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,672 copying deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,674 copying deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,676 copying deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,678 copying deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,679 copying deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,681 copying deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,683 copying deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,684 copying deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,686 copying deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/lib/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:00,688 creating build/lib/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:00,689 copying deepspeed/inference/v2/modules/configs/__init__.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:00,691 copying deepspeed/inference/v2/modules/configs/linear_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:00,692 copying deepspeed/inference/v2/modules/configs/moe_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:00,694 copying deepspeed/inference/v2/modules/configs/attention_configs.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:00,695 copying deepspeed/inference/v2/modules/configs/embedding_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:00,697 copying deepspeed/inference/v2/modules/configs/unembed_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:00,699 copying deepspeed/inference/v2/modules/configs/norm_config.py -> build/lib/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:00,701 creating build/lib/deepspeed/inference/v2/modules/implementations 2023-11-23T10:47:00,701 copying deepspeed/inference/v2/modules/implementations/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations 2023-11-23T10:47:00,704 creating build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:00,705 copying deepspeed/inference/v2/modules/interfaces/__init__.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:00,707 copying deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:00,709 copying deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:00,710 copying deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:00,712 copying deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:00,714 copying deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:00,716 copying deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:00,718 copying deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/lib/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:00,720 creating build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:00,722 copying deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:00,724 copying deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:00,726 copying deepspeed/inference/v2/modules/implementations/moe/test.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:00,728 copying deepspeed/inference/v2/modules/implementations/moe/gate_fn.py -> build/lib/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:00,730 creating build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-11-23T10:47:00,731 copying deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-11-23T10:47:00,734 copying deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/lib/deepspeed/inference/v2/modules/implementations/embedding 2023-11-23T10:47:00,736 creating build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-11-23T10:47:00,737 copying deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-11-23T10:47:00,739 copying deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/lib/deepspeed/inference/v2/modules/implementations/attention 2023-11-23T10:47:00,741 creating build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-23T10:47:00,742 copying deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-23T10:47:00,744 copying deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-23T10:47:00,747 creating build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-11-23T10:47:00,748 copying deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-11-23T10:47:00,750 copying deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/lib/deepspeed/inference/v2/modules/implementations/unembed 2023-11-23T10:47:00,752 creating build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-23T10:47:00,753 copying deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-23T10:47:00,755 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-23T10:47:00,757 copying deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/lib/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-23T10:47:00,759 creating build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-23T10:47:00,760 copying deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-23T10:47:00,762 copying deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-23T10:47:00,764 copying deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py -> build/lib/deepspeed/inference/v2/modules/implementations/linear 2023-11-23T10:47:00,766 creating build/lib/deepspeed/autotuning/tuner 2023-11-23T10:47:00,767 copying deepspeed/autotuning/tuner/__init__.py -> build/lib/deepspeed/autotuning/tuner 2023-11-23T10:47:00,769 copying deepspeed/autotuning/tuner/utils.py -> build/lib/deepspeed/autotuning/tuner 2023-11-23T10:47:00,770 copying deepspeed/autotuning/tuner/index_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-11-23T10:47:00,772 copying deepspeed/autotuning/tuner/cost_model.py -> build/lib/deepspeed/autotuning/tuner 2023-11-23T10:47:00,774 copying deepspeed/autotuning/tuner/base_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-11-23T10:47:00,776 copying deepspeed/autotuning/tuner/model_based_tuner.py -> build/lib/deepspeed/autotuning/tuner 2023-11-23T10:47:00,779 creating build/lib/deepspeed/model_implementations/features 2023-11-23T10:47:00,780 copying deepspeed/model_implementations/features/__init__.py -> build/lib/deepspeed/model_implementations/features 2023-11-23T10:47:00,782 copying deepspeed/model_implementations/features/cuda_graph.py -> build/lib/deepspeed/model_implementations/features 2023-11-23T10:47:00,785 creating build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,786 copying deepspeed/model_implementations/transformers/ds_transformer.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,788 copying deepspeed/model_implementations/transformers/__init__.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,790 copying deepspeed/model_implementations/transformers/ds_base.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,792 copying deepspeed/model_implementations/transformers/ds_bert.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,794 copying deepspeed/model_implementations/transformers/ds_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,795 copying deepspeed/model_implementations/transformers/ds_opt.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,797 copying deepspeed/model_implementations/transformers/ds_bloom.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,799 copying deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,800 copying deepspeed/model_implementations/transformers/ds_llama2.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,802 copying deepspeed/model_implementations/transformers/clip_encoder.py -> build/lib/deepspeed/model_implementations/transformers 2023-11-23T10:47:00,804 creating build/lib/deepspeed/model_implementations/diffusers 2023-11-23T10:47:00,805 copying deepspeed/model_implementations/diffusers/__init__.py -> build/lib/deepspeed/model_implementations/diffusers 2023-11-23T10:47:00,807 copying deepspeed/model_implementations/diffusers/unet.py -> build/lib/deepspeed/model_implementations/diffusers 2023-11-23T10:47:00,809 copying deepspeed/model_implementations/diffusers/vae.py -> build/lib/deepspeed/model_implementations/diffusers 2023-11-23T10:47:00,811 creating build/lib/deepspeed/ops/lion 2023-11-23T10:47:00,812 copying deepspeed/ops/lion/__init__.py -> build/lib/deepspeed/ops/lion 2023-11-23T10:47:00,814 copying deepspeed/ops/lion/multi_tensor_apply.py -> build/lib/deepspeed/ops/lion 2023-11-23T10:47:00,815 copying deepspeed/ops/lion/fused_lion.py -> build/lib/deepspeed/ops/lion 2023-11-23T10:47:00,817 copying deepspeed/ops/lion/cpu_lion.py -> build/lib/deepspeed/ops/lion 2023-11-23T10:47:00,820 creating build/lib/deepspeed/ops/random_ltd 2023-11-23T10:47:00,820 copying deepspeed/ops/random_ltd/__init__.py -> build/lib/deepspeed/ops/random_ltd 2023-11-23T10:47:00,822 copying deepspeed/ops/random_ltd/dropping_utils.py -> build/lib/deepspeed/ops/random_ltd 2023-11-23T10:47:00,825 creating build/lib/deepspeed/ops/deepspeed4science 2023-11-23T10:47:00,826 copying deepspeed/ops/deepspeed4science/__init__.py -> build/lib/deepspeed/ops/deepspeed4science 2023-11-23T10:47:00,827 copying deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/lib/deepspeed/ops/deepspeed4science 2023-11-23T10:47:00,831 creating build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,831 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,833 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,835 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,837 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,839 copying deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,840 copying deepspeed/ops/op_builder/all_ops.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,842 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,844 copying deepspeed/ops/op_builder/evoformer_attn.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,846 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,848 copying deepspeed/ops/op_builder/fused_lion.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,849 copying deepspeed/ops/op_builder/cpu_lion.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,851 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,854 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,855 copying deepspeed/ops/op_builder/ragged_utils.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,857 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,858 copying deepspeed/ops/op_builder/ragged_ops.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,860 copying deepspeed/ops/op_builder/spatial_inference.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,862 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,864 copying deepspeed/ops/op_builder/cpu_adagrad.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,865 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,867 copying deepspeed/ops/op_builder/random_ltd.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,869 copying deepspeed/ops/op_builder/inference_core_ops.py -> build/lib/deepspeed/ops/op_builder 2023-11-23T10:47:00,871 creating build/lib/deepspeed/ops/lamb 2023-11-23T10:47:00,872 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2023-11-23T10:47:00,874 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2023-11-23T10:47:00,876 creating build/lib/deepspeed/ops/adam 2023-11-23T10:47:00,877 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2023-11-23T10:47:00,879 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2023-11-23T10:47:00,881 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2023-11-23T10:47:00,883 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2023-11-23T10:47:00,886 creating build/lib/deepspeed/ops/transformer 2023-11-23T10:47:00,887 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2023-11-23T10:47:00,888 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2023-11-23T10:47:00,891 creating build/lib/deepspeed/ops/adagrad 2023-11-23T10:47:00,892 copying deepspeed/ops/adagrad/__init__.py -> build/lib/deepspeed/ops/adagrad 2023-11-23T10:47:00,894 copying deepspeed/ops/adagrad/cpu_adagrad.py -> build/lib/deepspeed/ops/adagrad 2023-11-23T10:47:00,897 creating build/lib/deepspeed/ops/sparse_attention 2023-11-23T10:47:00,897 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-23T10:47:00,899 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-23T10:47:00,901 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-23T10:47:00,904 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-23T10:47:00,907 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-23T10:47:00,910 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-23T10:47:00,912 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2023-11-23T10:47:00,915 creating build/lib/deepspeed/ops/quantizer 2023-11-23T10:47:00,916 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2023-11-23T10:47:00,918 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2023-11-23T10:47:00,920 creating build/lib/deepspeed/ops/aio 2023-11-23T10:47:00,921 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2023-11-23T10:47:00,923 creating build/lib/deepspeed/ops/op_builder/npu 2023-11-23T10:47:00,924 copying deepspeed/ops/op_builder/npu/__init__.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-23T10:47:00,926 copying deepspeed/ops/op_builder/npu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-23T10:47:00,927 copying deepspeed/ops/op_builder/npu/no_impl.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-23T10:47:00,929 copying deepspeed/ops/op_builder/npu/builder.py -> build/lib/deepspeed/ops/op_builder/npu 2023-11-23T10:47:00,931 creating build/lib/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:00,932 copying deepspeed/ops/op_builder/cpu/comm.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:00,934 copying deepspeed/ops/op_builder/cpu/__init__.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:00,936 copying deepspeed/ops/op_builder/cpu/fused_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:00,937 copying deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:00,939 copying deepspeed/ops/op_builder/cpu/no_impl.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:00,941 copying deepspeed/ops/op_builder/cpu/builder.py -> build/lib/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:00,943 creating build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,944 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,946 copying deepspeed/ops/transformer/inference/ds_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,948 copying deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,950 copying deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,952 copying deepspeed/ops/transformer/inference/ds_mlp.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,954 copying deepspeed/ops/transformer/inference/bias_add.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,955 copying deepspeed/ops/transformer/inference/moe_inference.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,957 copying deepspeed/ops/transformer/inference/config.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,959 copying deepspeed/ops/transformer/inference/diffusers_attention.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,962 copying deepspeed/ops/transformer/inference/triton_ops.py -> build/lib/deepspeed/ops/transformer/inference 2023-11-23T10:47:00,964 creating build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,965 copying deepspeed/ops/transformer/inference/triton/__init__.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,967 copying deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,969 copying deepspeed/ops/transformer/inference/triton/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,971 copying deepspeed/ops/transformer/inference/triton/softmax.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,973 copying deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,975 copying deepspeed/ops/transformer/inference/triton/attention.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,978 copying deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,980 copying deepspeed/ops/transformer/inference/triton/gelu.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,982 copying deepspeed/ops/transformer/inference/triton/mlp.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,984 copying deepspeed/ops/transformer/inference/triton/ops.py -> build/lib/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:00,987 creating build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:00,988 copying deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:00,990 copying deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:00,992 copying deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:00,993 copying deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:00,995 copying deepspeed/ops/transformer/inference/op_binding/linear.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:00,997 copying deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:00,998 copying deepspeed/ops/transformer/inference/op_binding/base.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:01,000 copying deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:01,002 copying deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:01,004 copying deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/lib/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:01,006 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:01,007 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:01,010 creating build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,011 copying deepspeed/module_inject/containers/distil_bert.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,013 copying deepspeed/module_inject/containers/__init__.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,015 copying deepspeed/module_inject/containers/clip.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,016 copying deepspeed/module_inject/containers/gpt2.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,018 copying deepspeed/module_inject/containers/llama2.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,020 copying deepspeed/module_inject/containers/megatron_gpt.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,022 copying deepspeed/module_inject/containers/gptneox.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,025 copying deepspeed/module_inject/containers/bloom.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,027 copying deepspeed/module_inject/containers/llama.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,029 copying deepspeed/module_inject/containers/opt.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,031 copying deepspeed/module_inject/containers/base.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,034 copying deepspeed/module_inject/containers/gptneo.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,036 copying deepspeed/module_inject/containers/unet.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,038 copying deepspeed/module_inject/containers/vae.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,039 copying deepspeed/module_inject/containers/base_moe.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,042 copying deepspeed/module_inject/containers/bert.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,044 copying deepspeed/module_inject/containers/gptj.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,046 copying deepspeed/module_inject/containers/internlm.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,048 copying deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/lib/deepspeed/module_inject/containers 2023-11-23T10:47:01,050 creating build/lib/deepspeed/module_inject/containers/features 2023-11-23T10:47:01,051 copying deepspeed/module_inject/containers/features/__init__.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-23T10:47:01,053 copying deepspeed/module_inject/containers/features/megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-23T10:47:01,054 copying deepspeed/module_inject/containers/features/hybrid_engine.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-23T10:47:01,056 copying deepspeed/module_inject/containers/features/gated_mlp.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-23T10:47:01,059 copying deepspeed/module_inject/containers/features/meta_tensor.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-23T10:47:01,060 copying deepspeed/module_inject/containers/features/split_qkv.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-23T10:47:01,062 copying deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/lib/deepspeed/module_inject/containers/features 2023-11-23T10:47:01,065 creating build/lib/deepspeed/runtime/data_pipeline 2023-11-23T10:47:01,066 copying deepspeed/runtime/data_pipeline/constants.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-23T10:47:01,068 copying deepspeed/runtime/data_pipeline/__init__.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-23T10:47:01,070 copying deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-23T10:47:01,072 copying deepspeed/runtime/data_pipeline/config.py -> build/lib/deepspeed/runtime/data_pipeline 2023-11-23T10:47:01,074 creating build/lib/deepspeed/runtime/compression 2023-11-23T10:47:01,075 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2023-11-23T10:47:01,077 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2023-11-23T10:47:01,079 creating build/lib/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:01,080 copying deepspeed/runtime/checkpoint_engine/__init__.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:01,082 copying deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:01,084 copying deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:01,086 copying deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/lib/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:01,088 creating build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,089 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,091 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,093 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,096 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,098 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,100 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,103 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,105 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,108 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2023-11-23T10:47:01,110 creating build/lib/deepspeed/runtime/activation_checkpointing 2023-11-23T10:47:01,111 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-11-23T10:47:01,113 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-11-23T10:47:01,117 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2023-11-23T10:47:01,119 creating build/lib/deepspeed/runtime/comm 2023-11-23T10:47:01,120 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2023-11-23T10:47:01,122 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2023-11-23T10:47:01,124 copying deepspeed/runtime/comm/coalesced_collectives.py -> build/lib/deepspeed/runtime/comm 2023-11-23T10:47:01,126 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2023-11-23T10:47:01,129 creating build/lib/deepspeed/runtime/fp16 2023-11-23T10:47:01,130 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2023-11-23T10:47:01,132 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2023-11-23T10:47:01,134 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-11-23T10:47:01,137 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2023-11-23T10:47:01,139 creating build/lib/deepspeed/runtime/pipe 2023-11-23T10:47:01,140 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2023-11-23T10:47:01,142 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2023-11-23T10:47:01,145 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2023-11-23T10:47:01,147 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2023-11-23T10:47:01,150 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2023-11-23T10:47:01,153 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2023-11-23T10:47:01,156 creating build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,157 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,159 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,162 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,165 copying deepspeed/runtime/zero/mics.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,167 copying deepspeed/runtime/zero/mics_utils.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,169 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,171 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,175 copying deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,178 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,180 copying deepspeed/runtime/zero/stage_1_and_2.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,185 copying deepspeed/runtime/zero/parameter_offload.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,187 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,190 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,192 copying deepspeed/runtime/zero/partitioned_param_profiler.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,194 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,196 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2023-11-23T10:47:01,199 creating build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:01,199 copying deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:01,201 copying deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:01,203 copying deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:01,205 copying deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:01,207 copying deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/lib/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:01,210 creating build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:01,211 copying deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:01,212 copying deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:01,215 copying deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:01,217 copying deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:01,219 copying deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/lib/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:01,222 creating build/lib/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:01,223 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:01,225 copying deepspeed/runtime/fp16/onebit/zoadam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:01,228 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:01,231 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:01,234 creating build/lib/deepspeed/profiling/flops_profiler 2023-11-23T10:47:01,235 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2023-11-23T10:47:01,236 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2023-11-23T10:47:01,240 running egg_info 2023-11-23T10:47:01,288 writing deepspeed.egg-info/PKG-INFO 2023-11-23T10:47:01,319 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2023-11-23T10:47:01,321 writing entry points to deepspeed.egg-info/entry_points.txt 2023-11-23T10:47:01,335 writing requirements to deepspeed.egg-info/requires.txt 2023-11-23T10:47:01,337 writing top-level names to deepspeed.egg-info/top_level.txt 2023-11-23T10:47:01,412 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-11-23T10:47:01,456 reading manifest template 'MANIFEST.in' 2023-11-23T10:47:01,457 warning: no files found matching 'deepspeed/inference/v2/kernels/ragged_ops/libs/*.so' 2023-11-23T10:47:01,458 warning: no files found matching 'deepspeed/inference/v2/kernels/cutlass_ops/libs/*.so' 2023-11-23T10:47:02,440 warning: no files found matching '*.hip' under directory 'deepspeed' 2023-11-23T10:47:03,218 warning: no files found matching '*.cc' under directory 'deepspeed' 2023-11-23T10:47:03,675 warning: no files found matching '*.tr' under directory 'csrc' 2023-11-23T10:47:03,774 warning: no files found matching '*.cc' under directory 'csrc' 2023-11-23T10:47:03,798 warning: no files found matching '*.py' under directory 'benchmarks' 2023-11-23T10:47:03,842 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2023-11-23T10:47:03,850 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.autotuning.config_templates' is absent from the `packages` configuration. 2023-11-23T10:47:03,850 !! 2023-11-23T10:47:03,851 ******************************************************************************** 2023-11-23T10:47:03,852 ############################ 2023-11-23T10:47:03,852 # Package would be ignored # 2023-11-23T10:47:03,853 ############################ 2023-11-23T10:47:03,853 Python recognizes 'deepspeed.autotuning.config_templates' as an importable package[^1], 2023-11-23T10:47:03,853 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:03,854 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:03,855 package, please make sure that 'deepspeed.autotuning.config_templates' is explicitly added 2023-11-23T10:47:03,855 to the `packages` configuration field. 2023-11-23T10:47:03,856 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:03,857 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:03,857 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:03,858 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:03,859 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:03,860 If you don't want 'deepspeed.autotuning.config_templates' to be distributed and are 2023-11-23T10:47:03,861 already explicitly excluding 'deepspeed.autotuning.config_templates' via 2023-11-23T10:47:03,861 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:03,862 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:03,862 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:03,864 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:03,865 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:03,866 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:03,867 even if it does not contain any `.py` files. 2023-11-23T10:47:03,867 On the other hand, currently there is no concept of package data 2023-11-23T10:47:03,868 directory, all directories are treated like packages. 2023-11-23T10:47:03,868 ******************************************************************************** 2023-11-23T10:47:03,869 !! 2023-11-23T10:47:03,869 check.warn(importable) 2023-11-23T10:47:03,870 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is absent from the `packages` configuration. 2023-11-23T10:47:03,871 !! 2023-11-23T10:47:03,872 ******************************************************************************** 2023-11-23T10:47:03,872 ############################ 2023-11-23T10:47:03,873 # Package would be ignored # 2023-11-23T10:47:03,874 ############################ 2023-11-23T10:47:03,874 Python recognizes 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' as an importable package[^1], 2023-11-23T10:47:03,874 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:03,876 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:03,876 package, please make sure that 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' is explicitly added 2023-11-23T10:47:03,877 to the `packages` configuration field. 2023-11-23T10:47:03,878 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:03,878 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:03,879 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:03,880 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:03,881 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:03,881 If you don't want 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' to be distributed and are 2023-11-23T10:47:03,882 already explicitly excluding 'deepspeed.inference.v2.kernels.cutlass_ops.shared_resources' via 2023-11-23T10:47:03,882 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:03,882 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:03,883 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:03,884 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:03,884 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:03,886 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:03,886 even if it does not contain any `.py` files. 2023-11-23T10:47:03,887 On the other hand, currently there is no concept of package data 2023-11-23T10:47:03,887 directory, all directories are treated like packages. 2023-11-23T10:47:03,887 ******************************************************************************** 2023-11-23T10:47:03,888 !! 2023-11-23T10:47:03,888 check.warn(importable) 2023-11-23T10:47:03,889 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.kernels.includes' is absent from the `packages` configuration. 2023-11-23T10:47:03,889 !! 2023-11-23T10:47:03,891 ******************************************************************************** 2023-11-23T10:47:03,891 ############################ 2023-11-23T10:47:03,892 # Package would be ignored # 2023-11-23T10:47:03,892 ############################ 2023-11-23T10:47:03,893 Python recognizes 'deepspeed.inference.v2.kernels.includes' as an importable package[^1], 2023-11-23T10:47:03,893 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:03,894 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:03,894 package, please make sure that 'deepspeed.inference.v2.kernels.includes' is explicitly added 2023-11-23T10:47:03,895 to the `packages` configuration field. 2023-11-23T10:47:03,896 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:03,896 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:03,897 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:03,898 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:03,899 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:03,900 If you don't want 'deepspeed.inference.v2.kernels.includes' to be distributed and are 2023-11-23T10:47:03,900 already explicitly excluding 'deepspeed.inference.v2.kernels.includes' via 2023-11-23T10:47:03,901 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:03,901 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:03,902 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:03,903 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:03,905 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:03,906 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:03,906 even if it does not contain any `.py` files. 2023-11-23T10:47:03,906 On the other hand, currently there is no concept of package data 2023-11-23T10:47:03,907 directory, all directories are treated like packages. 2023-11-23T10:47:03,907 ******************************************************************************** 2023-11-23T10:47:03,908 !! 2023-11-23T10:47:03,908 check.warn(importable) 2023-11-23T10:47:03,909 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is absent from the `packages` configuration. 2023-11-23T10:47:03,909 !! 2023-11-23T10:47:03,910 ******************************************************************************** 2023-11-23T10:47:03,911 ############################ 2023-11-23T10:47:03,911 # Package would be ignored # 2023-11-23T10:47:03,912 ############################ 2023-11-23T10:47:03,912 Python recognizes 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' as an importable package[^1], 2023-11-23T10:47:03,912 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:03,913 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:03,914 package, please make sure that 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' is explicitly added 2023-11-23T10:47:03,914 to the `packages` configuration field. 2023-11-23T10:47:03,915 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:03,916 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:03,916 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:03,917 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:03,918 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:03,919 If you don't want 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' to be distributed and are 2023-11-23T10:47:03,920 already explicitly excluding 'deepspeed.inference.v2.kernels.ragged_ops.ragged_helpers' via 2023-11-23T10:47:03,920 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:03,920 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:03,921 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:03,922 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:03,923 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:03,925 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:03,925 even if it does not contain any `.py` files. 2023-11-23T10:47:03,926 On the other hand, currently there is no concept of package data 2023-11-23T10:47:03,926 directory, all directories are treated like packages. 2023-11-23T10:47:03,927 ******************************************************************************** 2023-11-23T10:47:03,928 !! 2023-11-23T10:47:03,928 check.warn(importable) 2023-11-23T10:47:03,929 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.ragged.csrc' is absent from the `packages` configuration. 2023-11-23T10:47:03,929 !! 2023-11-23T10:47:03,930 ******************************************************************************** 2023-11-23T10:47:03,931 ############################ 2023-11-23T10:47:03,932 # Package would be ignored # 2023-11-23T10:47:03,932 ############################ 2023-11-23T10:47:03,932 Python recognizes 'deepspeed.inference.v2.ragged.csrc' as an importable package[^1], 2023-11-23T10:47:03,933 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:03,933 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:03,934 package, please make sure that 'deepspeed.inference.v2.ragged.csrc' is explicitly added 2023-11-23T10:47:03,934 to the `packages` configuration field. 2023-11-23T10:47:03,935 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:03,935 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:03,936 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:03,936 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:03,937 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:03,938 If you don't want 'deepspeed.inference.v2.ragged.csrc' to be distributed and are 2023-11-23T10:47:03,938 already explicitly excluding 'deepspeed.inference.v2.ragged.csrc' via 2023-11-23T10:47:03,939 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:03,939 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:03,939 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:03,940 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:03,942 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:03,943 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:03,944 even if it does not contain any `.py` files. 2023-11-23T10:47:03,944 On the other hand, currently there is no concept of package data 2023-11-23T10:47:03,945 directory, all directories are treated like packages. 2023-11-23T10:47:03,945 ******************************************************************************** 2023-11-23T10:47:03,946 !! 2023-11-23T10:47:03,947 check.warn(importable) 2023-11-23T10:47:03,947 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.inference.v2.ragged.includes' is absent from the `packages` configuration. 2023-11-23T10:47:03,948 !! 2023-11-23T10:47:03,948 ******************************************************************************** 2023-11-23T10:47:03,949 ############################ 2023-11-23T10:47:03,949 # Package would be ignored # 2023-11-23T10:47:03,950 ############################ 2023-11-23T10:47:03,950 Python recognizes 'deepspeed.inference.v2.ragged.includes' as an importable package[^1], 2023-11-23T10:47:03,951 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:03,952 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:03,952 package, please make sure that 'deepspeed.inference.v2.ragged.includes' is explicitly added 2023-11-23T10:47:03,953 to the `packages` configuration field. 2023-11-23T10:47:03,954 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:03,954 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:03,955 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:03,956 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:03,957 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:03,958 If you don't want 'deepspeed.inference.v2.ragged.includes' to be distributed and are 2023-11-23T10:47:03,958 already explicitly excluding 'deepspeed.inference.v2.ragged.includes' via 2023-11-23T10:47:03,959 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:03,959 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:03,959 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:03,960 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:03,961 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:03,962 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:03,963 even if it does not contain any `.py` files. 2023-11-23T10:47:03,963 On the other hand, currently there is no concept of package data 2023-11-23T10:47:03,964 directory, all directories are treated like packages. 2023-11-23T10:47:03,964 ******************************************************************************** 2023-11-23T10:47:03,965 !! 2023-11-23T10:47:03,965 check.warn(importable) 2023-11-23T10:47:03,966 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adagrad' is absent from the `packages` configuration. 2023-11-23T10:47:03,966 !! 2023-11-23T10:47:03,967 ******************************************************************************** 2023-11-23T10:47:03,967 ############################ 2023-11-23T10:47:03,968 # Package would be ignored # 2023-11-23T10:47:03,968 ############################ 2023-11-23T10:47:03,969 Python recognizes 'deepspeed.ops.csrc.adagrad' as an importable package[^1], 2023-11-23T10:47:03,969 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:03,970 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:03,971 package, please make sure that 'deepspeed.ops.csrc.adagrad' is explicitly added 2023-11-23T10:47:03,971 to the `packages` configuration field. 2023-11-23T10:47:03,972 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:03,973 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:03,973 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:03,974 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:03,975 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:03,976 If you don't want 'deepspeed.ops.csrc.adagrad' to be distributed and are 2023-11-23T10:47:03,977 already explicitly excluding 'deepspeed.ops.csrc.adagrad' via 2023-11-23T10:47:03,977 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:03,978 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:03,978 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:03,979 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:03,980 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:03,982 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:03,982 even if it does not contain any `.py` files. 2023-11-23T10:47:03,983 On the other hand, currently there is no concept of package data 2023-11-23T10:47:03,983 directory, all directories are treated like packages. 2023-11-23T10:47:03,984 ******************************************************************************** 2023-11-23T10:47:03,985 !! 2023-11-23T10:47:03,985 check.warn(importable) 2023-11-23T10:47:03,986 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.adam' is absent from the `packages` configuration. 2023-11-23T10:47:03,986 !! 2023-11-23T10:47:03,987 ******************************************************************************** 2023-11-23T10:47:03,987 ############################ 2023-11-23T10:47:03,988 # Package would be ignored # 2023-11-23T10:47:03,988 ############################ 2023-11-23T10:47:03,988 Python recognizes 'deepspeed.ops.csrc.adam' as an importable package[^1], 2023-11-23T10:47:03,989 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:03,989 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:03,990 package, please make sure that 'deepspeed.ops.csrc.adam' is explicitly added 2023-11-23T10:47:03,990 to the `packages` configuration field. 2023-11-23T10:47:03,991 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:03,991 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:03,991 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:03,992 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:03,993 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:03,994 If you don't want 'deepspeed.ops.csrc.adam' to be distributed and are 2023-11-23T10:47:03,994 already explicitly excluding 'deepspeed.ops.csrc.adam' via 2023-11-23T10:47:03,995 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:03,995 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:03,996 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:03,997 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:03,998 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:03,999 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:03,999 even if it does not contain any `.py` files. 2023-11-23T10:47:04,000 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,001 directory, all directories are treated like packages. 2023-11-23T10:47:04,001 ******************************************************************************** 2023-11-23T10:47:04,002 !! 2023-11-23T10:47:04,002 check.warn(importable) 2023-11-23T10:47:04,003 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.common' is absent from the `packages` configuration. 2023-11-23T10:47:04,003 !! 2023-11-23T10:47:04,004 ******************************************************************************** 2023-11-23T10:47:04,005 ############################ 2023-11-23T10:47:04,005 # Package would be ignored # 2023-11-23T10:47:04,006 ############################ 2023-11-23T10:47:04,006 Python recognizes 'deepspeed.ops.csrc.aio.common' as an importable package[^1], 2023-11-23T10:47:04,007 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,008 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,008 package, please make sure that 'deepspeed.ops.csrc.aio.common' is explicitly added 2023-11-23T10:47:04,009 to the `packages` configuration field. 2023-11-23T10:47:04,010 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,010 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,011 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,011 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,012 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,013 If you don't want 'deepspeed.ops.csrc.aio.common' to be distributed and are 2023-11-23T10:47:04,014 already explicitly excluding 'deepspeed.ops.csrc.aio.common' via 2023-11-23T10:47:04,014 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,015 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,015 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,016 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,017 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,018 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,018 even if it does not contain any `.py` files. 2023-11-23T10:47:04,019 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,019 directory, all directories are treated like packages. 2023-11-23T10:47:04,020 ******************************************************************************** 2023-11-23T10:47:04,021 !! 2023-11-23T10:47:04,021 check.warn(importable) 2023-11-23T10:47:04,021 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_lib' is absent from the `packages` configuration. 2023-11-23T10:47:04,022 !! 2023-11-23T10:47:04,023 ******************************************************************************** 2023-11-23T10:47:04,023 ############################ 2023-11-23T10:47:04,024 # Package would be ignored # 2023-11-23T10:47:04,024 ############################ 2023-11-23T10:47:04,025 Python recognizes 'deepspeed.ops.csrc.aio.py_lib' as an importable package[^1], 2023-11-23T10:47:04,025 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,026 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,026 package, please make sure that 'deepspeed.ops.csrc.aio.py_lib' is explicitly added 2023-11-23T10:47:04,027 to the `packages` configuration field. 2023-11-23T10:47:04,028 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,028 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,029 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,030 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,031 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,032 If you don't want 'deepspeed.ops.csrc.aio.py_lib' to be distributed and are 2023-11-23T10:47:04,032 already explicitly excluding 'deepspeed.ops.csrc.aio.py_lib' via 2023-11-23T10:47:04,033 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,033 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,034 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,035 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,036 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,038 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,038 even if it does not contain any `.py` files. 2023-11-23T10:47:04,038 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,039 directory, all directories are treated like packages. 2023-11-23T10:47:04,039 ******************************************************************************** 2023-11-23T10:47:04,040 !! 2023-11-23T10:47:04,040 check.warn(importable) 2023-11-23T10:47:04,041 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.aio.py_test' is absent from the `packages` configuration. 2023-11-23T10:47:04,041 !! 2023-11-23T10:47:04,042 ******************************************************************************** 2023-11-23T10:47:04,042 ############################ 2023-11-23T10:47:04,042 # Package would be ignored # 2023-11-23T10:47:04,043 ############################ 2023-11-23T10:47:04,043 Python recognizes 'deepspeed.ops.csrc.aio.py_test' as an importable package[^1], 2023-11-23T10:47:04,043 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,044 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,045 package, please make sure that 'deepspeed.ops.csrc.aio.py_test' is explicitly added 2023-11-23T10:47:04,045 to the `packages` configuration field. 2023-11-23T10:47:04,046 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,046 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,047 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,048 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,049 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,049 If you don't want 'deepspeed.ops.csrc.aio.py_test' to be distributed and are 2023-11-23T10:47:04,050 already explicitly excluding 'deepspeed.ops.csrc.aio.py_test' via 2023-11-23T10:47:04,050 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,051 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,051 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,052 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,053 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,055 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,055 even if it does not contain any `.py` files. 2023-11-23T10:47:04,056 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,056 directory, all directories are treated like packages. 2023-11-23T10:47:04,057 ******************************************************************************** 2023-11-23T10:47:04,058 !! 2023-11-23T10:47:04,058 check.warn(importable) 2023-11-23T10:47:04,059 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.common' is absent from the `packages` configuration. 2023-11-23T10:47:04,059 !! 2023-11-23T10:47:04,060 ******************************************************************************** 2023-11-23T10:47:04,061 ############################ 2023-11-23T10:47:04,061 # Package would be ignored # 2023-11-23T10:47:04,062 ############################ 2023-11-23T10:47:04,062 Python recognizes 'deepspeed.ops.csrc.common' as an importable package[^1], 2023-11-23T10:47:04,063 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,064 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,064 package, please make sure that 'deepspeed.ops.csrc.common' is explicitly added 2023-11-23T10:47:04,065 to the `packages` configuration field. 2023-11-23T10:47:04,065 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,066 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,066 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,067 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,068 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,068 If you don't want 'deepspeed.ops.csrc.common' to be distributed and are 2023-11-23T10:47:04,069 already explicitly excluding 'deepspeed.ops.csrc.common' via 2023-11-23T10:47:04,069 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,069 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,070 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,071 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,071 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,073 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,073 even if it does not contain any `.py` files. 2023-11-23T10:47:04,074 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,074 directory, all directories are treated like packages. 2023-11-23T10:47:04,075 ******************************************************************************** 2023-11-23T10:47:04,076 !! 2023-11-23T10:47:04,076 check.warn(importable) 2023-11-23T10:47:04,077 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.adam' is absent from the `packages` configuration. 2023-11-23T10:47:04,077 !! 2023-11-23T10:47:04,078 ******************************************************************************** 2023-11-23T10:47:04,078 ############################ 2023-11-23T10:47:04,079 # Package would be ignored # 2023-11-23T10:47:04,079 ############################ 2023-11-23T10:47:04,080 Python recognizes 'deepspeed.ops.csrc.cpu.adam' as an importable package[^1], 2023-11-23T10:47:04,080 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,081 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,082 package, please make sure that 'deepspeed.ops.csrc.cpu.adam' is explicitly added 2023-11-23T10:47:04,082 to the `packages` configuration field. 2023-11-23T10:47:04,083 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,084 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,084 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,085 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,086 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,088 If you don't want 'deepspeed.ops.csrc.cpu.adam' to be distributed and are 2023-11-23T10:47:04,088 already explicitly excluding 'deepspeed.ops.csrc.cpu.adam' via 2023-11-23T10:47:04,089 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,089 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,090 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,091 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,092 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,093 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,094 even if it does not contain any `.py` files. 2023-11-23T10:47:04,094 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,095 directory, all directories are treated like packages. 2023-11-23T10:47:04,095 ******************************************************************************** 2023-11-23T10:47:04,096 !! 2023-11-23T10:47:04,096 check.warn(importable) 2023-11-23T10:47:04,097 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.comm' is absent from the `packages` configuration. 2023-11-23T10:47:04,097 !! 2023-11-23T10:47:04,098 ******************************************************************************** 2023-11-23T10:47:04,099 ############################ 2023-11-23T10:47:04,100 # Package would be ignored # 2023-11-23T10:47:04,100 ############################ 2023-11-23T10:47:04,101 Python recognizes 'deepspeed.ops.csrc.cpu.comm' as an importable package[^1], 2023-11-23T10:47:04,101 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,102 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,103 package, please make sure that 'deepspeed.ops.csrc.cpu.comm' is explicitly added 2023-11-23T10:47:04,103 to the `packages` configuration field. 2023-11-23T10:47:04,104 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,105 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,105 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,106 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,107 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,109 If you don't want 'deepspeed.ops.csrc.cpu.comm' to be distributed and are 2023-11-23T10:47:04,109 already explicitly excluding 'deepspeed.ops.csrc.cpu.comm' via 2023-11-23T10:47:04,110 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,110 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,111 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,112 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,113 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,115 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,115 even if it does not contain any `.py` files. 2023-11-23T10:47:04,116 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,116 directory, all directories are treated like packages. 2023-11-23T10:47:04,117 ******************************************************************************** 2023-11-23T10:47:04,118 !! 2023-11-23T10:47:04,118 check.warn(importable) 2023-11-23T10:47:04,119 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.cpu.lion' is absent from the `packages` configuration. 2023-11-23T10:47:04,119 !! 2023-11-23T10:47:04,121 ******************************************************************************** 2023-11-23T10:47:04,121 ############################ 2023-11-23T10:47:04,122 # Package would be ignored # 2023-11-23T10:47:04,122 ############################ 2023-11-23T10:47:04,123 Python recognizes 'deepspeed.ops.csrc.cpu.lion' as an importable package[^1], 2023-11-23T10:47:04,123 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,124 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,124 package, please make sure that 'deepspeed.ops.csrc.cpu.lion' is explicitly added 2023-11-23T10:47:04,125 to the `packages` configuration field. 2023-11-23T10:47:04,126 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,127 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,127 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,128 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,129 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,130 If you don't want 'deepspeed.ops.csrc.cpu.lion' to be distributed and are 2023-11-23T10:47:04,131 already explicitly excluding 'deepspeed.ops.csrc.cpu.lion' via 2023-11-23T10:47:04,131 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,132 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,133 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,134 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,135 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,137 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,137 even if it does not contain any `.py` files. 2023-11-23T10:47:04,138 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,139 directory, all directories are treated like packages. 2023-11-23T10:47:04,139 ******************************************************************************** 2023-11-23T10:47:04,140 !! 2023-11-23T10:47:04,141 check.warn(importable) 2023-11-23T10:47:04,142 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is absent from the `packages` configuration. 2023-11-23T10:47:04,142 !! 2023-11-23T10:47:04,143 ******************************************************************************** 2023-11-23T10:47:04,144 ############################ 2023-11-23T10:47:04,145 # Package would be ignored # 2023-11-23T10:47:04,145 ############################ 2023-11-23T10:47:04,146 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' as an importable package[^1], 2023-11-23T10:47:04,147 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,149 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,150 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' is explicitly added 2023-11-23T10:47:04,150 to the `packages` configuration field. 2023-11-23T10:47:04,152 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,153 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,153 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,155 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,156 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,157 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' to be distributed and are 2023-11-23T10:47:04,158 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn' via 2023-11-23T10:47:04,159 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,159 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,160 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,162 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,163 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,164 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,165 even if it does not contain any `.py` files. 2023-11-23T10:47:04,165 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,165 directory, all directories are treated like packages. 2023-11-23T10:47:04,166 ******************************************************************************** 2023-11-23T10:47:04,166 !! 2023-11-23T10:47:04,167 check.warn(importable) 2023-11-23T10:47:04,167 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is absent from the `packages` configuration. 2023-11-23T10:47:04,168 !! 2023-11-23T10:47:04,168 ******************************************************************************** 2023-11-23T10:47:04,169 ############################ 2023-11-23T10:47:04,169 # Package would be ignored # 2023-11-23T10:47:04,170 ############################ 2023-11-23T10:47:04,170 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' as an importable package[^1], 2023-11-23T10:47:04,170 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,172 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,172 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' is explicitly added 2023-11-23T10:47:04,173 to the `packages` configuration field. 2023-11-23T10:47:04,174 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,175 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,176 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,178 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,180 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,181 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' to be distributed and are 2023-11-23T10:47:04,182 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.epilogue' via 2023-11-23T10:47:04,183 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,184 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,184 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,186 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,187 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,189 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,190 even if it does not contain any `.py` files. 2023-11-23T10:47:04,191 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,192 directory, all directories are treated like packages. 2023-11-23T10:47:04,192 ******************************************************************************** 2023-11-23T10:47:04,193 !! 2023-11-23T10:47:04,194 check.warn(importable) 2023-11-23T10:47:04,194 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is absent from the `packages` configuration. 2023-11-23T10:47:04,195 !! 2023-11-23T10:47:04,196 ******************************************************************************** 2023-11-23T10:47:04,197 ############################ 2023-11-23T10:47:04,198 # Package would be ignored # 2023-11-23T10:47:04,198 ############################ 2023-11-23T10:47:04,199 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' as an importable package[^1], 2023-11-23T10:47:04,199 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,200 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,201 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' is explicitly added 2023-11-23T10:47:04,202 to the `packages` configuration field. 2023-11-23T10:47:04,203 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,204 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,205 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,206 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,207 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,208 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' to be distributed and are 2023-11-23T10:47:04,209 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.gemm' via 2023-11-23T10:47:04,209 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,210 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,211 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,212 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,213 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,215 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,216 even if it does not contain any `.py` files. 2023-11-23T10:47:04,217 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,217 directory, all directories are treated like packages. 2023-11-23T10:47:04,218 ******************************************************************************** 2023-11-23T10:47:04,219 !! 2023-11-23T10:47:04,220 check.warn(importable) 2023-11-23T10:47:04,220 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is absent from the `packages` configuration. 2023-11-23T10:47:04,221 !! 2023-11-23T10:47:04,223 ******************************************************************************** 2023-11-23T10:47:04,223 ############################ 2023-11-23T10:47:04,224 # Package would be ignored # 2023-11-23T10:47:04,225 ############################ 2023-11-23T10:47:04,225 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' as an importable package[^1], 2023-11-23T10:47:04,226 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,228 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,228 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' is explicitly added 2023-11-23T10:47:04,228 to the `packages` configuration field. 2023-11-23T10:47:04,230 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,230 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,231 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,232 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,234 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,235 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' to be distributed and are 2023-11-23T10:47:04,236 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.iterators' via 2023-11-23T10:47:04,237 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,238 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,238 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,239 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,240 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,242 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,242 even if it does not contain any `.py` files. 2023-11-23T10:47:04,243 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,243 directory, all directories are treated like packages. 2023-11-23T10:47:04,244 ******************************************************************************** 2023-11-23T10:47:04,245 !! 2023-11-23T10:47:04,245 check.warn(importable) 2023-11-23T10:47:04,246 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is absent from the `packages` configuration. 2023-11-23T10:47:04,246 !! 2023-11-23T10:47:04,247 ******************************************************************************** 2023-11-23T10:47:04,248 ############################ 2023-11-23T10:47:04,248 # Package would be ignored # 2023-11-23T10:47:04,249 ############################ 2023-11-23T10:47:04,249 Python recognizes 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' as an importable package[^1], 2023-11-23T10:47:04,250 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,251 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,251 package, please make sure that 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' is explicitly added 2023-11-23T10:47:04,252 to the `packages` configuration field. 2023-11-23T10:47:04,253 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,254 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,254 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,255 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,256 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,257 If you don't want 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' to be distributed and are 2023-11-23T10:47:04,258 already explicitly excluding 'deepspeed.ops.csrc.deepspeed4science.evoformer_attn.transform' via 2023-11-23T10:47:04,258 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,259 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,259 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,260 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,261 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,262 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,263 even if it does not contain any `.py` files. 2023-11-23T10:47:04,263 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,264 directory, all directories are treated like packages. 2023-11-23T10:47:04,264 ******************************************************************************** 2023-11-23T10:47:04,265 !! 2023-11-23T10:47:04,266 check.warn(importable) 2023-11-23T10:47:04,266 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.includes' is absent from the `packages` configuration. 2023-11-23T10:47:04,267 !! 2023-11-23T10:47:04,268 ******************************************************************************** 2023-11-23T10:47:04,269 ############################ 2023-11-23T10:47:04,269 # Package would be ignored # 2023-11-23T10:47:04,270 ############################ 2023-11-23T10:47:04,270 Python recognizes 'deepspeed.ops.csrc.includes' as an importable package[^1], 2023-11-23T10:47:04,271 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,272 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,273 package, please make sure that 'deepspeed.ops.csrc.includes' is explicitly added 2023-11-23T10:47:04,273 to the `packages` configuration field. 2023-11-23T10:47:04,274 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,275 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,275 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,277 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,277 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,279 If you don't want 'deepspeed.ops.csrc.includes' to be distributed and are 2023-11-23T10:47:04,279 already explicitly excluding 'deepspeed.ops.csrc.includes' via 2023-11-23T10:47:04,280 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,281 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,282 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,283 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,284 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,286 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,287 even if it does not contain any `.py` files. 2023-11-23T10:47:04,288 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,288 directory, all directories are treated like packages. 2023-11-23T10:47:04,289 ******************************************************************************** 2023-11-23T10:47:04,291 !! 2023-11-23T10:47:04,292 check.warn(importable) 2023-11-23T10:47:04,292 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lamb' is absent from the `packages` configuration. 2023-11-23T10:47:04,293 !! 2023-11-23T10:47:04,294 ******************************************************************************** 2023-11-23T10:47:04,295 ############################ 2023-11-23T10:47:04,296 # Package would be ignored # 2023-11-23T10:47:04,296 ############################ 2023-11-23T10:47:04,297 Python recognizes 'deepspeed.ops.csrc.lamb' as an importable package[^1], 2023-11-23T10:47:04,297 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,299 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,300 package, please make sure that 'deepspeed.ops.csrc.lamb' is explicitly added 2023-11-23T10:47:04,300 to the `packages` configuration field. 2023-11-23T10:47:04,301 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,302 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,303 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,304 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,305 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,307 If you don't want 'deepspeed.ops.csrc.lamb' to be distributed and are 2023-11-23T10:47:04,308 already explicitly excluding 'deepspeed.ops.csrc.lamb' via 2023-11-23T10:47:04,308 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,309 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,310 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,311 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,313 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,315 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,316 even if it does not contain any `.py` files. 2023-11-23T10:47:04,317 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,317 directory, all directories are treated like packages. 2023-11-23T10:47:04,318 ******************************************************************************** 2023-11-23T10:47:04,319 !! 2023-11-23T10:47:04,320 check.warn(importable) 2023-11-23T10:47:04,320 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.lion' is absent from the `packages` configuration. 2023-11-23T10:47:04,321 !! 2023-11-23T10:47:04,322 ******************************************************************************** 2023-11-23T10:47:04,323 ############################ 2023-11-23T10:47:04,324 # Package would be ignored # 2023-11-23T10:47:04,324 ############################ 2023-11-23T10:47:04,325 Python recognizes 'deepspeed.ops.csrc.lion' as an importable package[^1], 2023-11-23T10:47:04,325 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,327 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,327 package, please make sure that 'deepspeed.ops.csrc.lion' is explicitly added 2023-11-23T10:47:04,328 to the `packages` configuration field. 2023-11-23T10:47:04,329 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,330 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,330 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,331 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,333 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,334 If you don't want 'deepspeed.ops.csrc.lion' to be distributed and are 2023-11-23T10:47:04,334 already explicitly excluding 'deepspeed.ops.csrc.lion' via 2023-11-23T10:47:04,335 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,335 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,336 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,337 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,338 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,340 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,340 even if it does not contain any `.py` files. 2023-11-23T10:47:04,341 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,341 directory, all directories are treated like packages. 2023-11-23T10:47:04,342 ******************************************************************************** 2023-11-23T10:47:04,343 !! 2023-11-23T10:47:04,344 check.warn(importable) 2023-11-23T10:47:04,344 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.quantization' is absent from the `packages` configuration. 2023-11-23T10:47:04,345 !! 2023-11-23T10:47:04,346 ******************************************************************************** 2023-11-23T10:47:04,347 ############################ 2023-11-23T10:47:04,348 # Package would be ignored # 2023-11-23T10:47:04,348 ############################ 2023-11-23T10:47:04,349 Python recognizes 'deepspeed.ops.csrc.quantization' as an importable package[^1], 2023-11-23T10:47:04,350 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,351 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,351 package, please make sure that 'deepspeed.ops.csrc.quantization' is explicitly added 2023-11-23T10:47:04,352 to the `packages` configuration field. 2023-11-23T10:47:04,354 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,355 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,355 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,357 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,359 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,360 If you don't want 'deepspeed.ops.csrc.quantization' to be distributed and are 2023-11-23T10:47:04,360 already explicitly excluding 'deepspeed.ops.csrc.quantization' via 2023-11-23T10:47:04,361 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,362 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,362 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,363 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,365 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,367 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,368 even if it does not contain any `.py` files. 2023-11-23T10:47:04,368 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,369 directory, all directories are treated like packages. 2023-11-23T10:47:04,370 ******************************************************************************** 2023-11-23T10:47:04,371 !! 2023-11-23T10:47:04,371 check.warn(importable) 2023-11-23T10:47:04,372 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.random_ltd' is absent from the `packages` configuration. 2023-11-23T10:47:04,372 !! 2023-11-23T10:47:04,374 ******************************************************************************** 2023-11-23T10:47:04,374 ############################ 2023-11-23T10:47:04,375 # Package would be ignored # 2023-11-23T10:47:04,375 ############################ 2023-11-23T10:47:04,376 Python recognizes 'deepspeed.ops.csrc.random_ltd' as an importable package[^1], 2023-11-23T10:47:04,377 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,378 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,379 package, please make sure that 'deepspeed.ops.csrc.random_ltd' is explicitly added 2023-11-23T10:47:04,379 to the `packages` configuration field. 2023-11-23T10:47:04,380 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,381 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,381 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,382 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,383 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,384 If you don't want 'deepspeed.ops.csrc.random_ltd' to be distributed and are 2023-11-23T10:47:04,384 already explicitly excluding 'deepspeed.ops.csrc.random_ltd' via 2023-11-23T10:47:04,385 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,386 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,386 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,387 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,388 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,389 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,390 even if it does not contain any `.py` files. 2023-11-23T10:47:04,390 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,391 directory, all directories are treated like packages. 2023-11-23T10:47:04,391 ******************************************************************************** 2023-11-23T10:47:04,392 !! 2023-11-23T10:47:04,393 check.warn(importable) 2023-11-23T10:47:04,393 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.sparse_attention' is absent from the `packages` configuration. 2023-11-23T10:47:04,394 !! 2023-11-23T10:47:04,395 ******************************************************************************** 2023-11-23T10:47:04,395 ############################ 2023-11-23T10:47:04,396 # Package would be ignored # 2023-11-23T10:47:04,397 ############################ 2023-11-23T10:47:04,397 Python recognizes 'deepspeed.ops.csrc.sparse_attention' as an importable package[^1], 2023-11-23T10:47:04,398 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,399 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,400 package, please make sure that 'deepspeed.ops.csrc.sparse_attention' is explicitly added 2023-11-23T10:47:04,400 to the `packages` configuration field. 2023-11-23T10:47:04,401 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,401 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,402 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,403 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,403 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,404 If you don't want 'deepspeed.ops.csrc.sparse_attention' to be distributed and are 2023-11-23T10:47:04,405 already explicitly excluding 'deepspeed.ops.csrc.sparse_attention' via 2023-11-23T10:47:04,405 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,406 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,406 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,407 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,408 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,409 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,410 even if it does not contain any `.py` files. 2023-11-23T10:47:04,410 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,411 directory, all directories are treated like packages. 2023-11-23T10:47:04,411 ******************************************************************************** 2023-11-23T10:47:04,412 !! 2023-11-23T10:47:04,412 check.warn(importable) 2023-11-23T10:47:04,413 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.csrc' is absent from the `packages` configuration. 2023-11-23T10:47:04,413 !! 2023-11-23T10:47:04,414 ******************************************************************************** 2023-11-23T10:47:04,415 ############################ 2023-11-23T10:47:04,415 # Package would be ignored # 2023-11-23T10:47:04,416 ############################ 2023-11-23T10:47:04,416 Python recognizes 'deepspeed.ops.csrc.spatial.csrc' as an importable package[^1], 2023-11-23T10:47:04,417 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,418 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,418 package, please make sure that 'deepspeed.ops.csrc.spatial.csrc' is explicitly added 2023-11-23T10:47:04,419 to the `packages` configuration field. 2023-11-23T10:47:04,420 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,420 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,421 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,422 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,423 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,424 If you don't want 'deepspeed.ops.csrc.spatial.csrc' to be distributed and are 2023-11-23T10:47:04,424 already explicitly excluding 'deepspeed.ops.csrc.spatial.csrc' via 2023-11-23T10:47:04,425 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,425 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,426 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,427 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,427 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,429 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,429 even if it does not contain any `.py` files. 2023-11-23T10:47:04,430 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,430 directory, all directories are treated like packages. 2023-11-23T10:47:04,431 ******************************************************************************** 2023-11-23T10:47:04,431 !! 2023-11-23T10:47:04,432 check.warn(importable) 2023-11-23T10:47:04,432 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.spatial.includes' is absent from the `packages` configuration. 2023-11-23T10:47:04,433 !! 2023-11-23T10:47:04,433 ******************************************************************************** 2023-11-23T10:47:04,434 ############################ 2023-11-23T10:47:04,434 # Package would be ignored # 2023-11-23T10:47:04,435 ############################ 2023-11-23T10:47:04,435 Python recognizes 'deepspeed.ops.csrc.spatial.includes' as an importable package[^1], 2023-11-23T10:47:04,436 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,437 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,437 package, please make sure that 'deepspeed.ops.csrc.spatial.includes' is explicitly added 2023-11-23T10:47:04,438 to the `packages` configuration field. 2023-11-23T10:47:04,438 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,439 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,439 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,440 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,441 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,442 If you don't want 'deepspeed.ops.csrc.spatial.includes' to be distributed and are 2023-11-23T10:47:04,443 already explicitly excluding 'deepspeed.ops.csrc.spatial.includes' via 2023-11-23T10:47:04,443 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,444 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,445 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,445 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,447 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,448 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,449 even if it does not contain any `.py` files. 2023-11-23T10:47:04,449 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,450 directory, all directories are treated like packages. 2023-11-23T10:47:04,450 ******************************************************************************** 2023-11-23T10:47:04,451 !! 2023-11-23T10:47:04,452 check.warn(importable) 2023-11-23T10:47:04,453 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer' is absent from the `packages` configuration. 2023-11-23T10:47:04,453 !! 2023-11-23T10:47:04,454 ******************************************************************************** 2023-11-23T10:47:04,455 ############################ 2023-11-23T10:47:04,455 # Package would be ignored # 2023-11-23T10:47:04,456 ############################ 2023-11-23T10:47:04,456 Python recognizes 'deepspeed.ops.csrc.transformer' as an importable package[^1], 2023-11-23T10:47:04,456 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,457 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,457 package, please make sure that 'deepspeed.ops.csrc.transformer' is explicitly added 2023-11-23T10:47:04,458 to the `packages` configuration field. 2023-11-23T10:47:04,459 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,459 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,460 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,461 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,461 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,463 If you don't want 'deepspeed.ops.csrc.transformer' to be distributed and are 2023-11-23T10:47:04,463 already explicitly excluding 'deepspeed.ops.csrc.transformer' via 2023-11-23T10:47:04,463 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,464 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,464 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,465 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,466 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,468 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,468 even if it does not contain any `.py` files. 2023-11-23T10:47:04,469 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,469 directory, all directories are treated like packages. 2023-11-23T10:47:04,470 ******************************************************************************** 2023-11-23T10:47:04,470 !! 2023-11-23T10:47:04,471 check.warn(importable) 2023-11-23T10:47:04,471 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.csrc' is absent from the `packages` configuration. 2023-11-23T10:47:04,472 !! 2023-11-23T10:47:04,473 ******************************************************************************** 2023-11-23T10:47:04,474 ############################ 2023-11-23T10:47:04,474 # Package would be ignored # 2023-11-23T10:47:04,475 ############################ 2023-11-23T10:47:04,475 Python recognizes 'deepspeed.ops.csrc.transformer.inference.csrc' as an importable package[^1], 2023-11-23T10:47:04,475 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,476 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,477 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.csrc' is explicitly added 2023-11-23T10:47:04,477 to the `packages` configuration field. 2023-11-23T10:47:04,478 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,479 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,479 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,481 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,481 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,482 If you don't want 'deepspeed.ops.csrc.transformer.inference.csrc' to be distributed and are 2023-11-23T10:47:04,483 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.csrc' via 2023-11-23T10:47:04,483 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,484 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,484 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,485 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,486 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,487 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,487 even if it does not contain any `.py` files. 2023-11-23T10:47:04,488 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,489 directory, all directories are treated like packages. 2023-11-23T10:47:04,489 ******************************************************************************** 2023-11-23T10:47:04,490 !! 2023-11-23T10:47:04,490 check.warn(importable) 2023-11-23T10:47:04,491 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.transformer.inference.includes' is absent from the `packages` configuration. 2023-11-23T10:47:04,491 !! 2023-11-23T10:47:04,492 ******************************************************************************** 2023-11-23T10:47:04,493 ############################ 2023-11-23T10:47:04,493 # Package would be ignored # 2023-11-23T10:47:04,494 ############################ 2023-11-23T10:47:04,494 Python recognizes 'deepspeed.ops.csrc.transformer.inference.includes' as an importable package[^1], 2023-11-23T10:47:04,495 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,496 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,496 package, please make sure that 'deepspeed.ops.csrc.transformer.inference.includes' is explicitly added 2023-11-23T10:47:04,497 to the `packages` configuration field. 2023-11-23T10:47:04,498 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,498 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,499 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,500 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,501 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,502 If you don't want 'deepspeed.ops.csrc.transformer.inference.includes' to be distributed and are 2023-11-23T10:47:04,502 already explicitly excluding 'deepspeed.ops.csrc.transformer.inference.includes' via 2023-11-23T10:47:04,503 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,503 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,503 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,505 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,506 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,507 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,508 even if it does not contain any `.py` files. 2023-11-23T10:47:04,508 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,509 directory, all directories are treated like packages. 2023-11-23T10:47:04,510 ******************************************************************************** 2023-11-23T10:47:04,511 !! 2023-11-23T10:47:04,511 check.warn(importable) 2023-11-23T10:47:04,511 /usr/local/lib/python3.11/dist-packages/setuptools/command/build_py.py:204: _Warning: Package 'deepspeed.ops.csrc.utils' is absent from the `packages` configuration. 2023-11-23T10:47:04,512 !! 2023-11-23T10:47:04,513 ******************************************************************************** 2023-11-23T10:47:04,513 ############################ 2023-11-23T10:47:04,514 # Package would be ignored # 2023-11-23T10:47:04,514 ############################ 2023-11-23T10:47:04,514 Python recognizes 'deepspeed.ops.csrc.utils' as an importable package[^1], 2023-11-23T10:47:04,515 but it is absent from setuptools' `packages` configuration. 2023-11-23T10:47:04,516 This leads to an ambiguous overall configuration. If you want to distribute this 2023-11-23T10:47:04,516 package, please make sure that 'deepspeed.ops.csrc.utils' is explicitly added 2023-11-23T10:47:04,517 to the `packages` configuration field. 2023-11-23T10:47:04,517 Alternatively, you can also rely on setuptools' discovery methods 2023-11-23T10:47:04,518 (for example by using `find_namespace_packages(...)`/`find_namespace:` 2023-11-23T10:47:04,519 instead of `find_packages(...)`/`find:`). 2023-11-23T10:47:04,519 You can read more about "package discovery" on setuptools documentation page: 2023-11-23T10:47:04,520 - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html 2023-11-23T10:47:04,521 If you don't want 'deepspeed.ops.csrc.utils' to be distributed and are 2023-11-23T10:47:04,522 already explicitly excluding 'deepspeed.ops.csrc.utils' via 2023-11-23T10:47:04,522 `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, 2023-11-23T10:47:04,523 you can try to use `exclude_package_data`, or `include-package-data=False` in 2023-11-23T10:47:04,523 combination with a more fine grained `package-data` configuration. 2023-11-23T10:47:04,525 You can read more about "package data files" on setuptools documentation page: 2023-11-23T10:47:04,525 - https://setuptools.pypa.io/en/latest/userguide/datafiles.html 2023-11-23T10:47:04,527 [^1]: For Python, any directory (with suitable naming) can be imported, 2023-11-23T10:47:04,528 even if it does not contain any `.py` files. 2023-11-23T10:47:04,528 On the other hand, currently there is no concept of package data 2023-11-23T10:47:04,529 directory, all directories are treated like packages. 2023-11-23T10:47:04,529 ******************************************************************************** 2023-11-23T10:47:04,530 !! 2023-11-23T10:47:04,530 check.warn(importable) 2023-11-23T10:47:04,531 creating build/lib/deepspeed/autotuning/config_templates 2023-11-23T10:47:04,531 copying deepspeed/autotuning/config_templates/template_zero0.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-23T10:47:04,532 copying deepspeed/autotuning/config_templates/template_zero1.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-23T10:47:04,532 copying deepspeed/autotuning/config_templates/template_zero2.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-23T10:47:04,533 copying deepspeed/autotuning/config_templates/template_zero3.json -> build/lib/deepspeed/autotuning/config_templates 2023-11-23T10:47:04,533 creating build/lib/deepspeed/ops/csrc 2023-11-23T10:47:04,534 creating build/lib/deepspeed/ops/csrc/adagrad 2023-11-23T10:47:04,535 copying deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/lib/deepspeed/ops/csrc/adagrad 2023-11-23T10:47:04,535 creating build/lib/deepspeed/ops/csrc/adam 2023-11-23T10:47:04,536 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-11-23T10:47:04,536 copying deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-11-23T10:47:04,536 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2023-11-23T10:47:04,537 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2023-11-23T10:47:04,537 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2023-11-23T10:47:04,537 creating build/lib/deepspeed/ops/csrc/aio 2023-11-23T10:47:04,538 creating build/lib/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:04,538 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:04,539 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:04,539 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:04,540 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:04,540 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:04,540 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:04,541 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,541 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,542 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,542 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,543 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,543 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,544 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,544 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,545 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,545 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,546 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,546 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:04,547 creating build/lib/deepspeed/ops/csrc/aio/py_test 2023-11-23T10:47:04,547 copying deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/lib/deepspeed/ops/csrc/aio/py_test 2023-11-23T10:47:04,548 creating build/lib/deepspeed/ops/csrc/common 2023-11-23T10:47:04,548 copying deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/common 2023-11-23T10:47:04,549 creating build/lib/deepspeed/ops/csrc/cpu 2023-11-23T10:47:04,549 creating build/lib/deepspeed/ops/csrc/cpu/adam 2023-11-23T10:47:04,550 copying deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/lib/deepspeed/ops/csrc/cpu/adam 2023-11-23T10:47:04,550 creating build/lib/deepspeed/ops/csrc/cpu/comm 2023-11-23T10:47:04,551 copying deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/lib/deepspeed/ops/csrc/cpu/comm 2023-11-23T10:47:04,551 creating build/lib/deepspeed/ops/csrc/cpu/lion 2023-11-23T10:47:04,552 copying deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/lib/deepspeed/ops/csrc/cpu/lion 2023-11-23T10:47:04,552 creating build/lib/deepspeed/ops/csrc/deepspeed4science 2023-11-23T10:47:04,553 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:04,553 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:04,554 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:04,554 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:04,555 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:04,555 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:04,556 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:04,556 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:04,557 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:04,557 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:04,558 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:04,558 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:04,558 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:04,559 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:04,560 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:04,560 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:04,561 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:04,561 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:04,562 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:04,562 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:04,563 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:04,563 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:04,564 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:04,564 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:04,565 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:04,565 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:04,566 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:04,566 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:04,567 creating build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-23T10:47:04,567 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-23T10:47:04,567 copying deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-23T10:47:04,568 creating build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,568 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,569 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,569 copying deepspeed/ops/csrc/includes/activation_type.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,569 copying deepspeed/ops/csrc/includes/compat.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,570 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,570 copying deepspeed/ops/csrc/includes/conversion_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,571 copying deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,571 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,572 copying deepspeed/ops/csrc/includes/cpu_lion.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,572 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,573 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,573 copying deepspeed/ops/csrc/includes/dequantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,574 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,574 copying deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,575 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,575 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,576 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,576 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,577 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,577 copying deepspeed/ops/csrc/includes/memory_access_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,578 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,578 copying deepspeed/ops/csrc/includes/quantization.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,579 copying deepspeed/ops/csrc/includes/quantization_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,580 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,580 copying deepspeed/ops/csrc/includes/reduction_utils.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,581 copying deepspeed/ops/csrc/includes/simd.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,581 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,581 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,582 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2023-11-23T10:47:04,582 creating build/lib/deepspeed/ops/csrc/lamb 2023-11-23T10:47:04,583 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2023-11-23T10:47:04,583 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2023-11-23T10:47:04,584 creating build/lib/deepspeed/ops/csrc/lion 2023-11-23T10:47:04,584 copying deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-11-23T10:47:04,585 copying deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-11-23T10:47:04,585 copying deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/lib/deepspeed/ops/csrc/lion 2023-11-23T10:47:04,586 copying deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/lion 2023-11-23T10:47:04,586 copying deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/lib/deepspeed/ops/csrc/lion 2023-11-23T10:47:04,586 creating build/lib/deepspeed/ops/csrc/quantization 2023-11-23T10:47:04,587 copying deepspeed/ops/csrc/quantization/dequantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-23T10:47:04,587 copying deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-23T10:47:04,588 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2023-11-23T10:47:04,588 copying deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-23T10:47:04,589 copying deepspeed/ops/csrc/quantization/quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-23T10:47:04,589 copying deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-23T10:47:04,590 copying deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/lib/deepspeed/ops/csrc/quantization 2023-11-23T10:47:04,590 creating build/lib/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:04,591 copying deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:04,591 copying deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:04,592 copying deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:04,592 copying deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/lib/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:04,593 creating build/lib/deepspeed/ops/csrc/sparse_attention 2023-11-23T10:47:04,593 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2023-11-23T10:47:04,594 creating build/lib/deepspeed/ops/csrc/spatial 2023-11-23T10:47:04,594 creating build/lib/deepspeed/ops/csrc/spatial/csrc 2023-11-23T10:47:04,595 copying deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-11-23T10:47:04,595 copying deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/spatial/csrc 2023-11-23T10:47:04,596 creating build/lib/deepspeed/ops/csrc/spatial/includes 2023-11-23T10:47:04,596 copying deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/lib/deepspeed/ops/csrc/spatial/includes 2023-11-23T10:47:04,597 creating build/lib/deepspeed/ops/csrc/transformer 2023-11-23T10:47:04,597 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-23T10:47:04,597 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-23T10:47:04,598 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2023-11-23T10:47:04,598 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-23T10:47:04,598 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-23T10:47:04,599 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-23T10:47:04,599 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-23T10:47:04,600 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2023-11-23T10:47:04,600 creating build/lib/deepspeed/ops/csrc/transformer/inference 2023-11-23T10:47:04,600 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,601 copying deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,601 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,602 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,602 copying deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,603 copying deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,603 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,604 copying deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,604 copying deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,605 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,605 copying deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:04,606 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-23T10:47:04,606 copying deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-23T10:47:04,607 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-23T10:47:04,607 copying deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2023-11-23T10:47:04,608 creating build/lib/deepspeed/ops/csrc/utils 2023-11-23T10:47:04,608 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2023-11-23T10:47:04,609 creating build/lib/deepspeed/inference/v2/ragged/csrc 2023-11-23T10:47:04,609 copying deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-11-23T10:47:04,610 copying deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/ragged/csrc 2023-11-23T10:47:04,611 creating build/lib/deepspeed/inference/v2/ragged/includes 2023-11-23T10:47:04,612 copying deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/lib/deepspeed/inference/v2/ragged/includes 2023-11-23T10:47:04,612 creating build/lib/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,613 copying deepspeed/inference/v2/kernels/includes/activation_type.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,613 copying deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,614 copying deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,614 copying deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,614 copying deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/lib/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,615 copying deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-23T10:47:04,615 creating build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-23T10:47:04,616 copying deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-23T10:47:04,616 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops 2023-11-23T10:47:04,617 creating build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-23T10:47:04,617 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-23T10:47:04,618 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-23T10:47:04,618 copying deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-23T10:47:04,619 copying deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops 2023-11-23T10:47:04,619 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:04,620 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:04,620 copying deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:04,621 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:04,622 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:04,623 copying deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:04,625 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:04,627 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:04,630 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:04,632 copying deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:04,634 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:04,636 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:04,638 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:04,640 copying deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:04,642 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:04,644 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:04,647 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:04,649 copying deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:04,651 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:04,653 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:04,655 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:04,657 copying deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:04,659 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:04,661 copying deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:04,663 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:04,665 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:04,667 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:04,669 copying deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:04,671 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:04,673 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:04,675 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:04,677 copying deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:04,679 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:04,681 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:04,683 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:04,685 copying deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:04,687 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:04,689 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:04,691 copying deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:04,693 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:04,695 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:04,697 copying deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:04,699 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:04,701 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:04,704 copying deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:04,706 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:04,709 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:04,711 copying deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:04,713 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:04,716 copying deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:04,718 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:04,721 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:04,723 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:04,767 running build_scripts 2023-11-23T10:47:04,768 creating build/scripts-3.11 2023-11-23T10:47:04,769 copying and adjusting bin/deepspeed -> build/scripts-3.11 2023-11-23T10:47:04,770 copying and adjusting bin/deepspeed.pt -> build/scripts-3.11 2023-11-23T10:47:04,772 copying and adjusting bin/ds -> build/scripts-3.11 2023-11-23T10:47:04,774 copying bin/ds_ssh -> build/scripts-3.11 2023-11-23T10:47:04,775 copying and adjusting bin/ds_report -> build/scripts-3.11 2023-11-23T10:47:04,777 copying and adjusting bin/ds_bench -> build/scripts-3.11 2023-11-23T10:47:04,778 copying and adjusting bin/dsr -> build/scripts-3.11 2023-11-23T10:47:04,779 copying and adjusting bin/ds_elastic -> build/scripts-3.11 2023-11-23T10:47:04,780 changing mode of build/scripts-3.11/deepspeed from 644 to 755 2023-11-23T10:47:04,781 changing mode of build/scripts-3.11/deepspeed.pt from 644 to 755 2023-11-23T10:47:04,782 changing mode of build/scripts-3.11/ds from 644 to 755 2023-11-23T10:47:04,782 changing mode of build/scripts-3.11/ds_report from 644 to 755 2023-11-23T10:47:04,783 changing mode of build/scripts-3.11/ds_bench from 644 to 755 2023-11-23T10:47:04,783 changing mode of build/scripts-3.11/dsr from 644 to 755 2023-11-23T10:47:04,784 changing mode of build/scripts-3.11/ds_elastic from 644 to 755 2023-11-23T10:47:04,806 /usr/local/lib/python3.11/dist-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated. 2023-11-23T10:47:04,807 !! 2023-11-23T10:47:04,808 ******************************************************************************** 2023-11-23T10:47:04,808 Please avoid running ``setup.py`` directly. 2023-11-23T10:47:04,809 Instead, use pypa/build, pypa/installer or other 2023-11-23T10:47:04,809 standards-based tools. 2023-11-23T10:47:04,810 See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. 2023-11-23T10:47:04,811 ******************************************************************************** 2023-11-23T10:47:04,812 !! 2023-11-23T10:47:04,812 self.initialize_options() 2023-11-23T10:47:04,830 installing to build/bdist.linux-armv7l/wheel 2023-11-23T10:47:04,831 running install 2023-11-23T10:47:04,855 running install_lib 2023-11-23T10:47:04,879 creating build/bdist.linux-armv7l 2023-11-23T10:47:04,880 creating build/bdist.linux-armv7l/wheel 2023-11-23T10:47:04,882 creating build/bdist.linux-armv7l/wheel/deepspeed 2023-11-23T10:47:04,883 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-23T10:47:04,884 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-23T10:47:04,887 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-23T10:47:04,888 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-23T10:47:04,890 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-23T10:47:04,892 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-23T10:47:04,893 copying build/lib/deepspeed/inference/quantization/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-23T10:47:04,895 copying build/lib/deepspeed/inference/quantization/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-23T10:47:04,897 copying build/lib/deepspeed/inference/quantization/quantization.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-23T10:47:04,899 copying build/lib/deepspeed/inference/quantization/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-23T10:47:04,901 copying build/lib/deepspeed/inference/quantization/quantization_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/quantization 2023-11-23T10:47:04,903 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-23T10:47:04,904 copying build/lib/deepspeed/inference/v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-23T10:47:04,906 copying build/lib/deepspeed/inference/v2/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-23T10:47:04,907 copying build/lib/deepspeed/inference/v2/scheduling_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-23T10:47:04,910 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:04,911 copying build/lib/deepspeed/inference/v2/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:04,913 copying build/lib/deepspeed/inference/v2/checkpoint/in_memory_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:04,915 copying build/lib/deepspeed/inference/v2/checkpoint/base_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:04,917 copying build/lib/deepspeed/inference/v2/checkpoint/huggingface_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/checkpoint 2023-11-23T10:47:04,919 copying build/lib/deepspeed/inference/v2/config_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-23T10:47:04,921 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-23T10:47:04,923 copying build/lib/deepspeed/inference/v2/ragged/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-23T10:47:04,925 copying build/lib/deepspeed/inference/v2/ragged/blocked_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-23T10:47:04,927 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2023-11-23T10:47:04,928 copying build/lib/deepspeed/inference/v2/ragged/includes/fast_host_buffer.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/includes 2023-11-23T10:47:04,931 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-11-23T10:47:04,932 copying build/lib/deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-11-23T10:47:04,934 copying build/lib/deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged/csrc 2023-11-23T10:47:04,936 copying build/lib/deepspeed/inference/v2/ragged/ragged_wrapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-23T10:47:04,938 copying build/lib/deepspeed/inference/v2/ragged/sequence_descriptor.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-23T10:47:04,941 copying build/lib/deepspeed/inference/v2/ragged/ragged_manager.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-23T10:47:04,943 copying build/lib/deepspeed/inference/v2/ragged/kv_cache.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-23T10:47:04,946 copying build/lib/deepspeed/inference/v2/ragged/manager_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/ragged 2023-11-23T10:47:04,948 copying build/lib/deepspeed/inference/v2/allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-23T10:47:04,950 copying build/lib/deepspeed/inference/v2/inference_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-23T10:47:04,953 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-11-23T10:47:04,954 copying build/lib/deepspeed/inference/v2/kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-11-23T10:47:04,956 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,958 copying build/lib/deepspeed/inference/v2/kernels/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,960 copying build/lib/deepspeed/inference/v2/kernels/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,963 copying build/lib/deepspeed/inference/v2/kernels/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,965 copying build/lib/deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,967 copying build/lib/deepspeed/inference/v2/kernels/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/includes 2023-11-23T10:47:04,971 copying build/lib/deepspeed/inference/v2/kernels/ds_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels 2023-11-23T10:47:04,973 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-23T10:47:04,974 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-23T10:47:04,976 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops 2023-11-23T10:47:04,979 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-23T10:47:04,980 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/shared_resources 2023-11-23T10:47:04,983 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:04,984 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:04,986 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:04,988 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:04,990 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:04,992 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm 2023-11-23T10:47:04,995 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:04,996 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:04,998 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:05,000 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:05,002 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:05,004 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:05,007 copying build/lib/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm 2023-11-23T10:47:05,010 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-11-23T10:47:05,011 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-11-23T10:47:05,014 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:05,015 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:05,017 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:05,019 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:05,021 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:05,024 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:05,026 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_gather 2023-11-23T10:47:05,029 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:05,030 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:05,032 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:05,034 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:05,036 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:05,039 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:05,041 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/embed 2023-11-23T10:47:05,043 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:05,045 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:05,047 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:05,049 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:05,051 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:05,053 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:05,056 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:05,058 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:05,060 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary 2023-11-23T10:47:05,063 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:05,065 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:05,067 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:05,069 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:05,071 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:05,073 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:05,075 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/blocked_flash 2023-11-23T10:47:05,079 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:05,080 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:05,083 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:05,085 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:05,087 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/atom_builder 2023-11-23T10:47:05,089 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:05,091 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:05,093 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:05,095 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:05,097 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:05,099 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:05,101 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/top_1_gating 2023-11-23T10:47:05,104 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops 2023-11-23T10:47:05,106 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:05,107 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:05,110 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:05,112 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:05,114 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:05,116 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:05,119 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/moe_scatter 2023-11-23T10:47:05,121 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:05,123 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:05,125 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:05,127 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:05,129 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:05,131 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:05,134 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/logits_gather 2023-11-23T10:47:05,136 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-23T10:47:05,137 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-23T10:47:05,139 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-23T10:47:05,141 copying build/lib/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers 2023-11-23T10:47:05,144 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-11-23T10:47:05,145 copying build/lib/deepspeed/inference/v2/kernels/core_ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-11-23T10:47:05,148 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:05,149 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:05,151 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:05,153 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:05,156 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:05,158 copying build/lib/deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/gated_activations 2023-11-23T10:47:05,161 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:05,162 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:05,164 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:05,166 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:05,168 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:05,170 copying build/lib/deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/bias_activations 2023-11-23T10:47:05,173 copying build/lib/deepspeed/inference/v2/kernels/core_ops/core_ops.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops 2023-11-23T10:47:05,175 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:05,176 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:05,179 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:05,181 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:05,183 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:05,186 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:05,188 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:05,189 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm 2023-11-23T10:47:05,192 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:05,192 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:05,194 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:05,197 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:05,198 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:05,201 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:05,202 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:05,204 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:05,206 copying build/lib/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm 2023-11-23T10:47:05,208 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:05,209 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:05,212 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:05,214 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:05,216 copying build/lib/deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/kernels/core_ops/blas_kernels 2023-11-23T10:47:05,218 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:05,219 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,221 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,222 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,225 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,227 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,229 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn_out.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,231 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,232 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,234 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,236 copying build/lib/deepspeed/inference/v2/model_implementations/sharding/embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/sharding 2023-11-23T10:47:05,238 copying build/lib/deepspeed/inference/v2/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:05,239 copying build/lib/deepspeed/inference/v2/model_implementations/inference_policy_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:05,242 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:05,243 copying build/lib/deepspeed/inference/v2/model_implementations/opt/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:05,245 copying build/lib/deepspeed/inference/v2/model_implementations/opt/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:05,246 copying build/lib/deepspeed/inference/v2/model_implementations/opt/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:05,248 copying build/lib/deepspeed/inference/v2/model_implementations/opt/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/opt 2023-11-23T10:47:05,250 copying build/lib/deepspeed/inference/v2/model_implementations/inference_transformer_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:05,253 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:05,253 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:05,255 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:05,257 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:05,259 copying build/lib/deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/llama_v2 2023-11-23T10:47:05,261 copying build/lib/deepspeed/inference/v2/model_implementations/parameter_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:05,263 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:05,264 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:05,266 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:05,268 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/container.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:05,269 copying build/lib/deepspeed/inference/v2/model_implementations/mistral/model.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/mistral 2023-11-23T10:47:05,271 copying build/lib/deepspeed/inference/v2/model_implementations/inference_model_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:05,274 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,275 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,277 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,279 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,281 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,282 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,284 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,286 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,287 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,289 copying build/lib/deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations/common_parameters 2023-11-23T10:47:05,291 copying build/lib/deepspeed/inference/v2/model_implementations/layer_container_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/model_implementations 2023-11-23T10:47:05,294 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-23T10:47:05,294 copying build/lib/deepspeed/inference/v2/modules/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-23T10:47:05,297 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:05,298 copying build/lib/deepspeed/inference/v2/modules/configs/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:05,300 copying build/lib/deepspeed/inference/v2/modules/configs/linear_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:05,301 copying build/lib/deepspeed/inference/v2/modules/configs/moe_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:05,303 copying build/lib/deepspeed/inference/v2/modules/configs/attention_configs.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:05,305 copying build/lib/deepspeed/inference/v2/modules/configs/embedding_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:05,307 copying build/lib/deepspeed/inference/v2/modules/configs/unembed_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:05,308 copying build/lib/deepspeed/inference/v2/modules/configs/norm_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/configs 2023-11-23T10:47:05,310 copying build/lib/deepspeed/inference/v2/modules/ds_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-23T10:47:05,312 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2023-11-23T10:47:05,313 copying build/lib/deepspeed/inference/v2/modules/implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations 2023-11-23T10:47:05,315 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:05,316 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:05,318 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:05,321 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:05,323 copying build/lib/deepspeed/inference/v2/modules/implementations/moe/gate_fn.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/moe 2023-11-23T10:47:05,325 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-11-23T10:47:05,326 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-11-23T10:47:05,327 copying build/lib/deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/embedding 2023-11-23T10:47:05,330 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-11-23T10:47:05,331 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-11-23T10:47:05,333 copying build/lib/deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/attention 2023-11-23T10:47:05,336 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-23T10:47:05,337 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-23T10:47:05,339 copying build/lib/deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/post_norm 2023-11-23T10:47:05,341 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-11-23T10:47:05,342 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-11-23T10:47:05,344 copying build/lib/deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/unembed 2023-11-23T10:47:05,346 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-23T10:47:05,347 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-23T10:47:05,349 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-23T10:47:05,351 copying build/lib/deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/pre_norm 2023-11-23T10:47:05,354 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-23T10:47:05,355 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-23T10:47:05,356 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-23T10:47:05,358 copying build/lib/deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/implementations/linear 2023-11-23T10:47:05,361 creating build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:05,362 copying build/lib/deepspeed/inference/v2/modules/interfaces/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:05,364 copying build/lib/deepspeed/inference/v2/modules/interfaces/attention_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:05,365 copying build/lib/deepspeed/inference/v2/modules/interfaces/post_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:05,367 copying build/lib/deepspeed/inference/v2/modules/interfaces/unembed_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:05,369 copying build/lib/deepspeed/inference/v2/modules/interfaces/embedding_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:05,371 copying build/lib/deepspeed/inference/v2/modules/interfaces/pre_norm_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:05,372 copying build/lib/deepspeed/inference/v2/modules/interfaces/moe_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:05,374 copying build/lib/deepspeed/inference/v2/modules/interfaces/linear_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules/interfaces 2023-11-23T10:47:05,376 copying build/lib/deepspeed/inference/v2/modules/module_registry.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-23T10:47:05,377 copying build/lib/deepspeed/inference/v2/modules/heuristics.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2/modules 2023-11-23T10:47:05,379 copying build/lib/deepspeed/inference/v2/engine_v2.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-23T10:47:05,381 copying build/lib/deepspeed/inference/v2/engine_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference/v2 2023-11-23T10:47:05,383 copying build/lib/deepspeed/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2023-11-23T10:47:05,385 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-23T10:47:05,388 creating build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-23T10:47:05,388 copying build/lib/deepspeed/monitor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-23T10:47:05,390 copying build/lib/deepspeed/monitor/wandb.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-23T10:47:05,392 copying build/lib/deepspeed/monitor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-23T10:47:05,393 copying build/lib/deepspeed/monitor/monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-23T10:47:05,395 copying build/lib/deepspeed/monitor/csv_monitor.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-23T10:47:05,397 copying build/lib/deepspeed/monitor/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-23T10:47:05,399 copying build/lib/deepspeed/monitor/tensorboard.py -> build/bdist.linux-armv7l/wheel/deepspeed/monitor 2023-11-23T10:47:05,401 creating build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-23T10:47:05,402 copying build/lib/deepspeed/moe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-23T10:47:05,404 copying build/lib/deepspeed/moe/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-23T10:47:05,406 copying build/lib/deepspeed/moe/mappings.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-23T10:47:05,408 copying build/lib/deepspeed/moe/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-23T10:47:05,410 copying build/lib/deepspeed/moe/sharded_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-23T10:47:05,413 copying build/lib/deepspeed/moe/experts.py -> build/bdist.linux-armv7l/wheel/deepspeed/moe 2023-11-23T10:47:05,415 creating build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-11-23T10:47:05,416 copying build/lib/deepspeed/sequence/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-11-23T10:47:05,418 copying build/lib/deepspeed/sequence/layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/sequence 2023-11-23T10:47:05,421 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-23T10:47:05,421 copying build/lib/deepspeed/autotuning/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-23T10:47:05,424 copying build/lib/deepspeed/autotuning/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-23T10:47:05,425 copying build/lib/deepspeed/autotuning/autotuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-23T10:47:05,428 copying build/lib/deepspeed/autotuning/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-23T10:47:05,430 copying build/lib/deepspeed/autotuning/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-23T10:47:05,433 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-23T10:47:05,434 copying build/lib/deepspeed/autotuning/tuner/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-23T10:47:05,436 copying build/lib/deepspeed/autotuning/tuner/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-23T10:47:05,442 copying build/lib/deepspeed/autotuning/tuner/index_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-23T10:47:05,443 copying build/lib/deepspeed/autotuning/tuner/cost_model.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-23T10:47:05,445 copying build/lib/deepspeed/autotuning/tuner/base_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-23T10:47:05,447 copying build/lib/deepspeed/autotuning/tuner/model_based_tuner.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/tuner 2023-11-23T10:47:05,449 copying build/lib/deepspeed/autotuning/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning 2023-11-23T10:47:05,452 creating build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-23T10:47:05,452 copying build/lib/deepspeed/autotuning/config_templates/template_zero0.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-23T10:47:05,454 copying build/lib/deepspeed/autotuning/config_templates/template_zero2.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-23T10:47:05,456 copying build/lib/deepspeed/autotuning/config_templates/template_zero3.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-23T10:47:05,458 copying build/lib/deepspeed/autotuning/config_templates/template_zero1.json -> build/bdist.linux-armv7l/wheel/deepspeed/autotuning/config_templates 2023-11-23T10:47:05,460 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-23T10:47:05,460 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-23T10:47:05,462 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-23T10:47:05,464 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-23T10:47:05,467 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-23T10:47:05,470 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2023-11-23T10:47:05,472 creating build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,473 copying build/lib/deepspeed/checkpoint/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,475 copying build/lib/deepspeed/checkpoint/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,477 copying build/lib/deepspeed/checkpoint/reshape_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,479 copying build/lib/deepspeed/checkpoint/ds_to_universal.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,481 copying build/lib/deepspeed/checkpoint/reshape_meg_2d.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,483 copying build/lib/deepspeed/checkpoint/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,485 copying build/lib/deepspeed/checkpoint/deepspeed_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,487 copying build/lib/deepspeed/checkpoint/zero_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,489 copying build/lib/deepspeed/checkpoint/universal_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,491 copying build/lib/deepspeed/checkpoint/reshape_3d_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/checkpoint 2023-11-23T10:47:05,493 creating build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-23T10:47:05,494 copying build/lib/deepspeed/compression/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-23T10:47:05,497 copying build/lib/deepspeed/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-23T10:47:05,498 copying build/lib/deepspeed/compression/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-23T10:47:05,500 copying build/lib/deepspeed/compression/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-23T10:47:05,502 copying build/lib/deepspeed/compression/compress.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-23T10:47:05,505 copying build/lib/deepspeed/compression/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-23T10:47:05,507 copying build/lib/deepspeed/compression/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-23T10:47:05,510 copying build/lib/deepspeed/compression/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/compression 2023-11-23T10:47:05,512 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-23T10:47:05,515 creating build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-23T10:47:05,516 copying build/lib/deepspeed/accelerator/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-23T10:47:05,517 copying build/lib/deepspeed/accelerator/npu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-23T10:47:05,519 copying build/lib/deepspeed/accelerator/real_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-23T10:47:05,521 copying build/lib/deepspeed/accelerator/cpu_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-23T10:47:05,523 copying build/lib/deepspeed/accelerator/cuda_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-23T10:47:05,526 copying build/lib/deepspeed/accelerator/abstract_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-23T10:47:05,528 copying build/lib/deepspeed/accelerator/mps_accelerator.py -> build/bdist.linux-armv7l/wheel/deepspeed/accelerator 2023-11-23T10:47:05,530 copying build/lib/deepspeed/pydantic_v1.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-23T10:47:05,532 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-11-23T10:47:05,533 copying build/lib/deepspeed/model_implementations/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations 2023-11-23T10:47:05,535 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-11-23T10:47:05,536 copying build/lib/deepspeed/model_implementations/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-11-23T10:47:05,538 copying build/lib/deepspeed/model_implementations/features/cuda_graph.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/features 2023-11-23T10:47:05,540 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,541 copying build/lib/deepspeed/model_implementations/transformers/ds_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,544 copying build/lib/deepspeed/model_implementations/transformers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,545 copying build/lib/deepspeed/model_implementations/transformers/ds_base.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,547 copying build/lib/deepspeed/model_implementations/transformers/ds_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,549 copying build/lib/deepspeed/model_implementations/transformers/ds_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,551 copying build/lib/deepspeed/model_implementations/transformers/ds_opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,552 copying build/lib/deepspeed/model_implementations/transformers/ds_bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,554 copying build/lib/deepspeed/model_implementations/transformers/ds_megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,556 copying build/lib/deepspeed/model_implementations/transformers/ds_llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,558 copying build/lib/deepspeed/model_implementations/transformers/clip_encoder.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/transformers 2023-11-23T10:47:05,560 creating build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-23T10:47:05,561 copying build/lib/deepspeed/model_implementations/diffusers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-23T10:47:05,563 copying build/lib/deepspeed/model_implementations/diffusers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-23T10:47:05,565 copying build/lib/deepspeed/model_implementations/diffusers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/model_implementations/diffusers 2023-11-23T10:47:05,568 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,569 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,570 copying build/lib/deepspeed/utils/init_on_device.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,572 copying build/lib/deepspeed/utils/tensor_fragment.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,575 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,577 copying build/lib/deepspeed/utils/nvtx.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,579 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,593 copying build/lib/deepspeed/utils/comms_logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,596 copying build/lib/deepspeed/utils/mixed_precision_linkage.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,598 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,602 copying build/lib/deepspeed/utils/groups.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,605 copying build/lib/deepspeed/utils/exceptions.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,607 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,610 copying build/lib/deepspeed/utils/numa.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,613 copying build/lib/deepspeed/utils/types.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2023-11-23T10:47:05,616 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-11-23T10:47:05,617 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-23T10:47:05,619 copying build/lib/deepspeed/ops/lion/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-23T10:47:05,621 copying build/lib/deepspeed/ops/lion/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-23T10:47:05,624 copying build/lib/deepspeed/ops/lion/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-23T10:47:05,626 copying build/lib/deepspeed/ops/lion/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lion 2023-11-23T10:47:05,629 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2023-11-23T10:47:05,632 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-11-23T10:47:05,633 copying build/lib/deepspeed/ops/random_ltd/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-11-23T10:47:05,635 copying build/lib/deepspeed/ops/random_ltd/dropping_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/random_ltd 2023-11-23T10:47:05,638 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-11-23T10:47:05,639 copying build/lib/deepspeed/ops/deepspeed4science/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-11-23T10:47:05,641 copying build/lib/deepspeed/ops/deepspeed4science/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/deepspeed4science 2023-11-23T10:47:05,645 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,646 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,648 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,650 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,653 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,655 copying build/lib/deepspeed/ops/op_builder/inference_cutlass_builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,657 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-23T10:47:05,658 copying build/lib/deepspeed/ops/op_builder/npu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-23T10:47:05,661 copying build/lib/deepspeed/ops/op_builder/npu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-23T10:47:05,663 copying build/lib/deepspeed/ops/op_builder/npu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-23T10:47:05,665 copying build/lib/deepspeed/ops/op_builder/npu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/npu 2023-11-23T10:47:05,667 copying build/lib/deepspeed/ops/op_builder/all_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,669 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,672 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:05,673 copying build/lib/deepspeed/ops/op_builder/cpu/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:05,675 copying build/lib/deepspeed/ops/op_builder/cpu/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:05,678 copying build/lib/deepspeed/ops/op_builder/cpu/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:05,680 copying build/lib/deepspeed/ops/op_builder/cpu/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:05,682 copying build/lib/deepspeed/ops/op_builder/cpu/no_impl.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:05,684 copying build/lib/deepspeed/ops/op_builder/cpu/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder/cpu 2023-11-23T10:47:05,686 copying build/lib/deepspeed/ops/op_builder/evoformer_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,688 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,690 copying build/lib/deepspeed/ops/op_builder/fused_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,692 copying build/lib/deepspeed/ops/op_builder/cpu_lion.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,694 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,696 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,698 copying build/lib/deepspeed/ops/op_builder/ragged_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,700 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,702 copying build/lib/deepspeed/ops/op_builder/ragged_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,704 copying build/lib/deepspeed/ops/op_builder/spatial_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,705 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,707 copying build/lib/deepspeed/ops/op_builder/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,709 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,711 copying build/lib/deepspeed/ops/op_builder/random_ltd.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,713 copying build/lib/deepspeed/ops/op_builder/inference_core_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2023-11-23T10:47:05,715 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-11-23T10:47:05,716 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-11-23T10:47:05,718 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2023-11-23T10:47:05,721 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2023-11-23T10:47:05,723 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-23T10:47:05,724 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_lion.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-23T10:47:05,726 copying build/lib/deepspeed/ops/csrc/lion/fused_lion_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-23T10:47:05,728 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-23T10:47:05,730 copying build/lib/deepspeed/ops/csrc/lion/cpu_lion_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-23T10:47:05,733 copying build/lib/deepspeed/ops/csrc/lion/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lion 2023-11-23T10:47:05,736 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:05,737 copying build/lib/deepspeed/ops/csrc/random_ltd/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:05,739 copying build/lib/deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:05,742 copying build/lib/deepspeed/ops/csrc/random_ltd/token_sort.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:05,744 copying build/lib/deepspeed/ops/csrc/random_ltd/gather_scatter.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/random_ltd 2023-11-23T10:47:05,747 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science 2023-11-23T10:47:05,748 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:05,749 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:05,751 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:05,753 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:05,754 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:05,756 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:05,759 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:05,762 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:05,764 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:05,767 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:05,770 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators 2023-11-23T10:47:05,773 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:05,774 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:05,776 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:05,778 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:05,781 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue 2023-11-23T10:47:05,783 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:05,784 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:05,787 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:05,789 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:05,792 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:05,795 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:05,800 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:05,803 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm 2023-11-23T10:47:05,806 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:05,809 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:05,813 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-23T10:47:05,814 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-23T10:47:05,817 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform 2023-11-23T10:47:05,820 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:05,825 copying build/lib/deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/deepspeed4science/evoformer_attn 2023-11-23T10:47:05,830 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-11-23T10:47:05,831 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-11-23T10:47:05,834 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2023-11-23T10:47:05,838 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,839 copying build/lib/deepspeed/ops/csrc/includes/activation_type.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,841 copying build/lib/deepspeed/ops/csrc/includes/cpu_adagrad.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,844 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,847 copying build/lib/deepspeed/ops/csrc/includes/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,849 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,851 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,854 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,856 copying build/lib/deepspeed/ops/csrc/includes/simd.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,859 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,861 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,865 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,867 copying build/lib/deepspeed/ops/csrc/includes/cpu_lion.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,870 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,872 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,875 copying build/lib/deepspeed/ops/csrc/includes/reduction_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,878 copying build/lib/deepspeed/ops/csrc/includes/dequantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,880 copying build/lib/deepspeed/ops/csrc/includes/conversion_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,883 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,886 copying build/lib/deepspeed/ops/csrc/includes/quantization_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,889 copying build/lib/deepspeed/ops/csrc/includes/quantization.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,892 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,894 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,896 copying build/lib/deepspeed/ops/csrc/includes/ds_kernel_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,898 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,900 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,902 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,904 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,906 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,908 copying build/lib/deepspeed/ops/csrc/includes/memory_access_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2023-11-23T10:47:05,911 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu 2023-11-23T10:47:05,913 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-11-23T10:47:05,914 copying build/lib/deepspeed/ops/csrc/cpu/lion/fused_lion.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/lion 2023-11-23T10:47:05,916 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-11-23T10:47:05,917 copying build/lib/deepspeed/ops/csrc/cpu/adam/fused_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/adam 2023-11-23T10:47:05,920 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-11-23T10:47:05,920 copying build/lib/deepspeed/ops/csrc/cpu/comm/ccl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/cpu/comm 2023-11-23T10:47:05,923 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial 2023-11-23T10:47:05,924 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-11-23T10:47:05,925 copying build/lib/deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/includes 2023-11-23T10:47:05,927 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-11-23T10:47:05,928 copying build/lib/deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-11-23T10:47:05,930 copying build/lib/deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/spatial/csrc 2023-11-23T10:47:05,933 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-23T10:47:05,934 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam_impl.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-23T10:47:05,936 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-23T10:47:05,938 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-23T10:47:05,940 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-23T10:47:05,942 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2023-11-23T10:47:05,944 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-23T10:47:05,945 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2023-11-23T10:47:05,947 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-23T10:47:05,948 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-23T10:47:05,951 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-23T10:47:05,953 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/inference_context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2023-11-23T10:47:05,955 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,956 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,959 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,962 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,966 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,968 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/relu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,970 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,972 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,975 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,977 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/transform.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,980 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2023-11-23T10:47:05,982 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-23T10:47:05,985 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-23T10:47:05,988 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-23T10:47:05,991 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-23T10:47:05,993 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-23T10:47:05,995 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-23T10:47:05,998 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-23T10:47:06,001 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2023-11-23T10:47:06,005 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-23T10:47:06,006 copying build/lib/deepspeed/ops/csrc/quantization/swizzled_quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-23T10:47:06,009 copying build/lib/deepspeed/ops/csrc/quantization/fake_quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-23T10:47:06,012 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-23T10:47:06,015 copying build/lib/deepspeed/ops/csrc/quantization/quantize_intX.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-23T10:47:06,017 copying build/lib/deepspeed/ops/csrc/quantization/quantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-23T10:47:06,019 copying build/lib/deepspeed/ops/csrc/quantization/quant_reduce.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-23T10:47:06,022 copying build/lib/deepspeed/ops/csrc/quantization/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2023-11-23T10:47:06,024 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-11-23T10:47:06,025 copying build/lib/deepspeed/ops/csrc/common/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/common 2023-11-23T10:47:06,027 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-11-23T10:47:06,028 copying build/lib/deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adagrad 2023-11-23T10:47:06,031 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-11-23T10:47:06,032 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2023-11-23T10:47:06,034 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-11-23T10:47:06,035 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2023-11-23T10:47:06,038 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2023-11-23T10:47:06,040 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,041 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,042 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,044 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,046 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,048 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,049 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,051 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,053 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,055 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,057 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,059 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2023-11-23T10:47:06,061 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:06,062 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:06,064 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:06,066 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:06,068 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:06,069 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:06,072 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2023-11-23T10:47:06,074 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-11-23T10:47:06,075 copying build/lib/deepspeed/ops/csrc/aio/py_test/single_process_config.json -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_test 2023-11-23T10:47:06,077 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-23T10:47:06,078 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-23T10:47:06,080 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-23T10:47:06,082 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-23T10:47:06,084 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2023-11-23T10:47:06,086 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-11-23T10:47:06,088 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-11-23T10:47:06,090 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,091 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,092 copying build/lib/deepspeed/ops/transformer/inference/ds_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,095 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,096 copying build/lib/deepspeed/ops/transformer/inference/triton/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,098 copying build/lib/deepspeed/ops/transformer/inference/triton/layer_norm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,100 copying build/lib/deepspeed/ops/transformer/inference/triton/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,102 copying build/lib/deepspeed/ops/transformer/inference/triton/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,103 copying build/lib/deepspeed/ops/transformer/inference/triton/matmul_ext.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,106 copying build/lib/deepspeed/ops/transformer/inference/triton/attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,108 copying build/lib/deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,110 copying build/lib/deepspeed/ops/transformer/inference/triton/gelu.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,112 copying build/lib/deepspeed/ops/transformer/inference/triton/mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,115 copying build/lib/deepspeed/ops/transformer/inference/triton/ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/triton 2023-11-23T10:47:06,117 copying build/lib/deepspeed/ops/transformer/inference/diffusers_transformer_block.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,119 copying build/lib/deepspeed/ops/transformer/inference/diffusers_2d_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,121 copying build/lib/deepspeed/ops/transformer/inference/ds_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,123 copying build/lib/deepspeed/ops/transformer/inference/bias_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,125 copying build/lib/deepspeed/ops/transformer/inference/moe_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,127 copying build/lib/deepspeed/ops/transformer/inference/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,130 copying build/lib/deepspeed/ops/transformer/inference/diffusers_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,132 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,133 copying build/lib/deepspeed/ops/transformer/inference/op_binding/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,135 copying build/lib/deepspeed/ops/transformer/inference/op_binding/residual_add.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,137 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,139 copying build/lib/deepspeed/ops/transformer/inference/op_binding/vector_matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,141 copying build/lib/deepspeed/ops/transformer/inference/op_binding/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,143 copying build/lib/deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,145 copying build/lib/deepspeed/ops/transformer/inference/op_binding/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,146 copying build/lib/deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,149 copying build/lib/deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,151 copying build/lib/deepspeed/ops/transformer/inference/op_binding/softmax_context.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference/op_binding 2023-11-23T10:47:06,153 copying build/lib/deepspeed/ops/transformer/inference/triton_ops.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2023-11-23T10:47:06,155 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2023-11-23T10:47:06,158 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-11-23T10:47:06,159 copying build/lib/deepspeed/ops/adagrad/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-11-23T10:47:06,161 copying build/lib/deepspeed/ops/adagrad/cpu_adagrad.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adagrad 2023-11-23T10:47:06,164 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-23T10:47:06,165 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-23T10:47:06,166 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-23T10:47:06,168 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-23T10:47:06,171 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:06,172 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:06,174 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:06,176 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:06,178 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2023-11-23T10:47:06,181 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-23T10:47:06,183 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-23T10:47:06,187 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-23T10:47:06,189 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2023-11-23T10:47:06,192 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-11-23T10:47:06,193 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-11-23T10:47:06,195 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2023-11-23T10:47:06,197 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-11-23T10:47:06,198 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2023-11-23T10:47:06,200 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2023-11-23T10:47:06,202 creating build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,203 copying build/lib/deepspeed/comm/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,205 copying build/lib/deepspeed/comm/comm.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,207 copying build/lib/deepspeed/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,209 copying build/lib/deepspeed/comm/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,211 copying build/lib/deepspeed/comm/ccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,213 copying build/lib/deepspeed/comm/reduce_op.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,214 copying build/lib/deepspeed/comm/torch.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,217 copying build/lib/deepspeed/comm/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,218 copying build/lib/deepspeed/comm/backend.py -> build/bdist.linux-armv7l/wheel/deepspeed/comm 2023-11-23T10:47:06,221 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,221 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,223 copying build/lib/deepspeed/module_inject/policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,225 copying build/lib/deepspeed/module_inject/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,227 copying build/lib/deepspeed/module_inject/tp_shard.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,229 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,231 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,233 copying build/lib/deepspeed/module_inject/fusedqkv_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,236 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,237 copying build/lib/deepspeed/module_inject/containers/distil_bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,239 copying build/lib/deepspeed/module_inject/containers/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,241 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-23T10:47:06,242 copying build/lib/deepspeed/module_inject/containers/features/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-23T10:47:06,244 copying build/lib/deepspeed/module_inject/containers/features/megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-23T10:47:06,245 copying build/lib/deepspeed/module_inject/containers/features/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-23T10:47:06,248 copying build/lib/deepspeed/module_inject/containers/features/gated_mlp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-23T10:47:06,250 copying build/lib/deepspeed/module_inject/containers/features/meta_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-23T10:47:06,252 copying build/lib/deepspeed/module_inject/containers/features/split_qkv.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-23T10:47:06,254 copying build/lib/deepspeed/module_inject/containers/features/hybrid_megatron.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers/features 2023-11-23T10:47:06,256 copying build/lib/deepspeed/module_inject/containers/clip.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,258 copying build/lib/deepspeed/module_inject/containers/gpt2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,259 copying build/lib/deepspeed/module_inject/containers/llama2.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,261 copying build/lib/deepspeed/module_inject/containers/megatron_gpt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,263 copying build/lib/deepspeed/module_inject/containers/gptneox.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,265 copying build/lib/deepspeed/module_inject/containers/bloom.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,267 copying build/lib/deepspeed/module_inject/containers/llama.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,270 copying build/lib/deepspeed/module_inject/containers/opt.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,272 copying build/lib/deepspeed/module_inject/containers/base.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,274 copying build/lib/deepspeed/module_inject/containers/gptneo.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,276 copying build/lib/deepspeed/module_inject/containers/unet.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,278 copying build/lib/deepspeed/module_inject/containers/vae.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,280 copying build/lib/deepspeed/module_inject/containers/base_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,282 copying build/lib/deepspeed/module_inject/containers/bert.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,284 copying build/lib/deepspeed/module_inject/containers/gptj.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,286 copying build/lib/deepspeed/module_inject/containers/internlm.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,288 copying build/lib/deepspeed/module_inject/containers/megatron_gpt_moe.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject/containers 2023-11-23T10:47:06,290 copying build/lib/deepspeed/module_inject/layers.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,291 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,294 copying build/lib/deepspeed/module_inject/load_checkpoint.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,296 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,297 copying build/lib/deepspeed/module_inject/auto_tp.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,300 copying build/lib/deepspeed/module_inject/auto_tp_model_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2023-11-23T10:47:06,302 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-11-23T10:47:06,303 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2023-11-23T10:47:06,306 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,306 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,309 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,310 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,313 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,314 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,317 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,319 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-23T10:47:06,320 copying build/lib/deepspeed/runtime/data_pipeline/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-23T10:47:06,323 copying build/lib/deepspeed/runtime/data_pipeline/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-23T10:47:06,325 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:06,326 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:06,328 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:06,330 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:06,332 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/basic_layer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:06,334 copying build/lib/deepspeed/runtime/data_pipeline/data_routing/helper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_routing 2023-11-23T10:47:06,336 copying build/lib/deepspeed/runtime/data_pipeline/curriculum_scheduler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-23T10:47:06,339 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:06,340 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:06,342 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:06,344 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:06,346 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:06,349 copying build/lib/deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline/data_sampling 2023-11-23T10:47:06,351 copying build/lib/deepspeed/runtime/data_pipeline/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/data_pipeline 2023-11-23T10:47:06,353 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,356 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,359 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,362 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-11-23T10:47:06,362 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-11-23T10:47:06,364 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2023-11-23T10:47:06,366 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,368 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,373 copying build/lib/deepspeed/runtime/hybrid_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,375 copying build/lib/deepspeed/runtime/bf16_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,378 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,380 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:06,381 copying build/lib/deepspeed/runtime/checkpoint_engine/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:06,383 copying build/lib/deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:06,385 copying build/lib/deepspeed/runtime/checkpoint_engine/checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:06,386 copying build/lib/deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/checkpoint_engine 2023-11-23T10:47:06,389 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,390 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,392 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,394 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,396 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,399 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,402 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,404 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,406 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,408 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2023-11-23T10:47:06,411 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,414 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-23T10:47:06,415 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-23T10:47:06,417 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-23T10:47:06,420 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2023-11-23T10:47:06,423 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-23T10:47:06,423 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-23T10:47:06,425 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-23T10:47:06,428 copying build/lib/deepspeed/runtime/comm/coalesced_collectives.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-23T10:47:06,430 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2023-11-23T10:47:06,433 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-23T10:47:06,434 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-23T10:47:06,436 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-23T10:47:06,440 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:06,441 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:06,443 copying build/lib/deepspeed/runtime/fp16/onebit/zoadam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:06,445 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:06,448 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2023-11-23T10:47:06,450 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-23T10:47:06,453 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2023-11-23T10:47:06,456 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-23T10:47:06,457 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-23T10:47:06,459 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-23T10:47:06,462 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-23T10:47:06,464 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-23T10:47:06,467 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-23T10:47:06,470 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2023-11-23T10:47:06,473 copying build/lib/deepspeed/runtime/sparse_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2023-11-23T10:47:06,475 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,476 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,478 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,482 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,485 copying build/lib/deepspeed/runtime/zero/mics.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,488 copying build/lib/deepspeed/runtime/zero/mics_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,490 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,492 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,497 copying build/lib/deepspeed/runtime/zero/partitioned_param_coordinator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,500 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,502 copying build/lib/deepspeed/runtime/zero/stage_1_and_2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,506 copying build/lib/deepspeed/runtime/zero/parameter_offload.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,508 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,510 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,513 copying build/lib/deepspeed/runtime/zero/partitioned_param_profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,515 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,517 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2023-11-23T10:47:06,519 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-23T10:47:06,520 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-23T10:47:06,522 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-23T10:47:06,524 copying build/lib/deepspeed/elasticity/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-23T10:47:06,526 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-23T10:47:06,528 copying build/lib/deepspeed/elasticity/elastic_agent.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-23T10:47:06,530 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2023-11-23T10:47:06,533 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-23T10:47:06,534 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-23T10:47:06,536 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-23T10:47:06,538 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-11-23T10:47:06,539 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-11-23T10:47:06,541 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2023-11-23T10:47:06,544 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2023-11-23T10:47:06,546 creating build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-23T10:47:06,547 copying build/lib/deepspeed/nebula/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-23T10:47:06,550 copying build/lib/deepspeed/nebula/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-23T10:47:06,551 copying build/lib/deepspeed/nebula/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/nebula 2023-11-23T10:47:06,553 running install_egg_info 2023-11-23T10:47:06,587 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.12.3-py3.11.egg-info 2023-11-23T10:47:06,603 running install_scripts 2023-11-23T10:47:06,604 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data 2023-11-23T10:47:06,605 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts 2023-11-23T10:47:06,606 copying build/scripts-3.11/dsr -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts 2023-11-23T10:47:06,609 copying build/scripts-3.11/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts 2023-11-23T10:47:06,611 copying build/scripts-3.11/ds_bench -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts 2023-11-23T10:47:06,613 copying build/scripts-3.11/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts 2023-11-23T10:47:06,616 copying build/scripts-3.11/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts 2023-11-23T10:47:06,618 copying build/scripts-3.11/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts 2023-11-23T10:47:06,620 copying build/scripts-3.11/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts 2023-11-23T10:47:06,623 copying build/scripts-3.11/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts 2023-11-23T10:47:06,625 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts/dsr to 755 2023-11-23T10:47:06,626 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts/ds_ssh to 755 2023-11-23T10:47:06,626 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts/ds_bench to 755 2023-11-23T10:47:06,627 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts/deepspeed.pt to 755 2023-11-23T10:47:06,627 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts/deepspeed to 755 2023-11-23T10:47:06,628 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts/ds to 755 2023-11-23T10:47:06,629 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts/ds_report to 755 2023-11-23T10:47:06,630 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.data/scripts/ds_elastic to 755 2023-11-23T10:47:06,696 creating build/bdist.linux-armv7l/wheel/deepspeed-0.12.3.dist-info/WHEEL 2023-11-23T10:47:06,698 creating '/tmp/pip-wheel-n2mmkk6o/deepspeed-0.12.3-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-11-23T10:47:06,701 adding 'deepspeed/__init__.py' 2023-11-23T10:47:06,703 adding 'deepspeed/constants.py' 2023-11-23T10:47:06,705 adding 'deepspeed/env_report.py' 2023-11-23T10:47:06,706 adding 'deepspeed/git_version_info.py' 2023-11-23T10:47:06,707 adding 'deepspeed/git_version_info_installed.py' 2023-11-23T10:47:06,708 adding 'deepspeed/pydantic_v1.py' 2023-11-23T10:47:06,710 adding 'deepspeed/accelerator/__init__.py' 2023-11-23T10:47:06,712 adding 'deepspeed/accelerator/abstract_accelerator.py' 2023-11-23T10:47:06,713 adding 'deepspeed/accelerator/cpu_accelerator.py' 2023-11-23T10:47:06,715 adding 'deepspeed/accelerator/cuda_accelerator.py' 2023-11-23T10:47:06,717 adding 'deepspeed/accelerator/mps_accelerator.py' 2023-11-23T10:47:06,718 adding 'deepspeed/accelerator/npu_accelerator.py' 2023-11-23T10:47:06,720 adding 'deepspeed/accelerator/real_accelerator.py' 2023-11-23T10:47:06,722 adding 'deepspeed/autotuning/__init__.py' 2023-11-23T10:47:06,727 adding 'deepspeed/autotuning/autotuner.py' 2023-11-23T10:47:06,729 adding 'deepspeed/autotuning/config.py' 2023-11-23T10:47:06,730 adding 'deepspeed/autotuning/constants.py' 2023-11-23T10:47:06,733 adding 'deepspeed/autotuning/scheduler.py' 2023-11-23T10:47:06,735 adding 'deepspeed/autotuning/utils.py' 2023-11-23T10:47:06,737 adding 'deepspeed/autotuning/config_templates/template_zero0.json' 2023-11-23T10:47:06,738 adding 'deepspeed/autotuning/config_templates/template_zero1.json' 2023-11-23T10:47:06,739 adding 'deepspeed/autotuning/config_templates/template_zero2.json' 2023-11-23T10:47:06,741 adding 'deepspeed/autotuning/config_templates/template_zero3.json' 2023-11-23T10:47:06,742 adding 'deepspeed/autotuning/tuner/__init__.py' 2023-11-23T10:47:06,744 adding 'deepspeed/autotuning/tuner/base_tuner.py' 2023-11-23T10:47:06,745 adding 'deepspeed/autotuning/tuner/cost_model.py' 2023-11-23T10:47:06,746 adding 'deepspeed/autotuning/tuner/index_based_tuner.py' 2023-11-23T10:47:06,748 adding 'deepspeed/autotuning/tuner/model_based_tuner.py' 2023-11-23T10:47:06,749 adding 'deepspeed/autotuning/tuner/utils.py' 2023-11-23T10:47:06,751 adding 'deepspeed/checkpoint/__init__.py' 2023-11-23T10:47:06,752 adding 'deepspeed/checkpoint/constants.py' 2023-11-23T10:47:06,754 adding 'deepspeed/checkpoint/deepspeed_checkpoint.py' 2023-11-23T10:47:06,756 adding 'deepspeed/checkpoint/ds_to_universal.py' 2023-11-23T10:47:06,758 adding 'deepspeed/checkpoint/reshape_3d_utils.py' 2023-11-23T10:47:06,759 adding 'deepspeed/checkpoint/reshape_meg_2d.py' 2023-11-23T10:47:06,761 adding 'deepspeed/checkpoint/reshape_utils.py' 2023-11-23T10:47:06,762 adding 'deepspeed/checkpoint/universal_checkpoint.py' 2023-11-23T10:47:06,764 adding 'deepspeed/checkpoint/utils.py' 2023-11-23T10:47:06,765 adding 'deepspeed/checkpoint/zero_checkpoint.py' 2023-11-23T10:47:06,767 adding 'deepspeed/comm/__init__.py' 2023-11-23T10:47:06,768 adding 'deepspeed/comm/backend.py' 2023-11-23T10:47:06,769 adding 'deepspeed/comm/ccl.py' 2023-11-23T10:47:06,772 adding 'deepspeed/comm/comm.py' 2023-11-23T10:47:06,774 adding 'deepspeed/comm/config.py' 2023-11-23T10:47:06,775 adding 'deepspeed/comm/constants.py' 2023-11-23T10:47:06,776 adding 'deepspeed/comm/reduce_op.py' 2023-11-23T10:47:06,778 adding 'deepspeed/comm/torch.py' 2023-11-23T10:47:06,779 adding 'deepspeed/comm/utils.py' 2023-11-23T10:47:06,781 adding 'deepspeed/compression/__init__.py' 2023-11-23T10:47:06,784 adding 'deepspeed/compression/basic_layer.py' 2023-11-23T10:47:06,786 adding 'deepspeed/compression/compress.py' 2023-11-23T10:47:06,788 adding 'deepspeed/compression/config.py' 2023-11-23T10:47:06,790 adding 'deepspeed/compression/constants.py' 2023-11-23T10:47:06,792 adding 'deepspeed/compression/helper.py' 2023-11-23T10:47:06,794 adding 'deepspeed/compression/scheduler.py' 2023-11-23T10:47:06,795 adding 'deepspeed/compression/utils.py' 2023-11-23T10:47:06,797 adding 'deepspeed/elasticity/__init__.py' 2023-11-23T10:47:06,798 adding 'deepspeed/elasticity/config.py' 2023-11-23T10:47:06,800 adding 'deepspeed/elasticity/constants.py' 2023-11-23T10:47:06,801 adding 'deepspeed/elasticity/elastic_agent.py' 2023-11-23T10:47:06,804 adding 'deepspeed/elasticity/elasticity.py' 2023-11-23T10:47:06,805 adding 'deepspeed/elasticity/utils.py' 2023-11-23T10:47:06,806 adding 'deepspeed/inference/__init__.py' 2023-11-23T10:47:06,808 adding 'deepspeed/inference/config.py' 2023-11-23T10:47:06,812 adding 'deepspeed/inference/engine.py' 2023-11-23T10:47:06,814 adding 'deepspeed/inference/quantization/__init__.py' 2023-11-23T10:47:06,815 adding 'deepspeed/inference/quantization/layers.py' 2023-11-23T10:47:06,816 adding 'deepspeed/inference/quantization/quantization.py' 2023-11-23T10:47:06,818 adding 'deepspeed/inference/quantization/quantization_context.py' 2023-11-23T10:47:06,819 adding 'deepspeed/inference/quantization/utils.py' 2023-11-23T10:47:06,821 adding 'deepspeed/inference/v2/__init__.py' 2023-11-23T10:47:06,822 adding 'deepspeed/inference/v2/allocator.py' 2023-11-23T10:47:06,824 adding 'deepspeed/inference/v2/config_v2.py' 2023-11-23T10:47:06,825 adding 'deepspeed/inference/v2/engine_factory.py' 2023-11-23T10:47:06,827 adding 'deepspeed/inference/v2/engine_v2.py' 2023-11-23T10:47:06,828 adding 'deepspeed/inference/v2/inference_utils.py' 2023-11-23T10:47:06,829 adding 'deepspeed/inference/v2/logging.py' 2023-11-23T10:47:06,830 adding 'deepspeed/inference/v2/scheduling_utils.py' 2023-11-23T10:47:06,832 adding 'deepspeed/inference/v2/checkpoint/__init__.py' 2023-11-23T10:47:06,833 adding 'deepspeed/inference/v2/checkpoint/base_engine.py' 2023-11-23T10:47:06,835 adding 'deepspeed/inference/v2/checkpoint/huggingface_engine.py' 2023-11-23T10:47:06,836 adding 'deepspeed/inference/v2/checkpoint/in_memory_engine.py' 2023-11-23T10:47:06,838 adding 'deepspeed/inference/v2/kernels/__init__.py' 2023-11-23T10:47:06,839 adding 'deepspeed/inference/v2/kernels/ds_kernel.py' 2023-11-23T10:47:06,841 adding 'deepspeed/inference/v2/kernels/core_ops/__init__.py' 2023-11-23T10:47:06,842 adding 'deepspeed/inference/v2/kernels/core_ops/core_ops.cpp' 2023-11-23T10:47:06,843 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/__init__.py' 2023-11-23T10:47:06,845 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cpp' 2023-11-23T10:47:06,846 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.cu' 2023-11-23T10:47:06,847 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.h' 2023-11-23T10:47:06,849 adding 'deepspeed/inference/v2/kernels/core_ops/bias_activations/bias_activation.py' 2023-11-23T10:47:06,850 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/__init__.py' 2023-11-23T10:47:06,852 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas.h' 2023-11-23T10:47:06,853 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_linear.py' 2023-11-23T10:47:06,855 adding 'deepspeed/inference/v2/kernels/core_ops/blas_kernels/blas_utils.h' 2023-11-23T10:47:06,856 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/__init__.py' 2023-11-23T10:47:06,857 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_fp_ln_base.py' 2023-11-23T10:47:06,858 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_ln.py' 2023-11-23T10:47:06,860 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_post_ln.py' 2023-11-23T10:47:06,861 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/cuda_pre_ln.py' 2023-11-23T10:47:06,862 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cpp' 2023-11-23T10:47:06,864 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.cu' 2023-11-23T10:47:06,865 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_layer_norm/layer_norm.h' 2023-11-23T10:47:06,867 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/__init__.py' 2023-11-23T10:47:06,869 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cpp' 2023-11-23T10:47:06,870 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.cu' 2023-11-23T10:47:06,871 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.h' 2023-11-23T10:47:06,873 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm.py' 2023-11-23T10:47:06,874 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_norm_base.py' 2023-11-23T10:47:06,875 adding 'deepspeed/inference/v2/kernels/core_ops/cuda_rms_norm/rms_pre_norm.py' 2023-11-23T10:47:06,877 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/__init__.py' 2023-11-23T10:47:06,878 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation.py' 2023-11-23T10:47:06,879 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cpp' 2023-11-23T10:47:06,881 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.cu' 2023-11-23T10:47:06,882 adding 'deepspeed/inference/v2/kernels/core_ops/gated_activations/gated_activation_kernels.h' 2023-11-23T10:47:06,884 adding 'deepspeed/inference/v2/kernels/cutlass_ops/__init__.py' 2023-11-23T10:47:06,885 adding 'deepspeed/inference/v2/kernels/cutlass_ops/cutlass_ops.cpp' 2023-11-23T10:47:06,887 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/__init__.py' 2023-11-23T10:47:06,888 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.cu' 2023-11-23T10:47:06,889 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.h' 2023-11-23T10:47:06,891 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm.py' 2023-11-23T10:47:06,892 adding 'deepspeed/inference/v2/kernels/cutlass_ops/mixed_gemm/mixed_gemm_api.h' 2023-11-23T10:47:06,894 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/__init__.py' 2023-11-23T10:47:06,895 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/mixed_moe_gemm.py' 2023-11-23T10:47:06,896 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.cu' 2023-11-23T10:47:06,897 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.h' 2023-11-23T10:47:06,899 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm.py' 2023-11-23T10:47:06,900 adding 'deepspeed/inference/v2/kernels/cutlass_ops/moe_gemm/moe_gemm_api.h' 2023-11-23T10:47:06,901 adding 'deepspeed/inference/v2/kernels/cutlass_ops/shared_resources/weight_variant.h' 2023-11-23T10:47:06,903 adding 'deepspeed/inference/v2/kernels/includes/activation_type.h' 2023-11-23T10:47:06,904 adding 'deepspeed/inference/v2/kernels/includes/conversion_utils.h' 2023-11-23T10:47:06,906 adding 'deepspeed/inference/v2/kernels/includes/ds_kernel_utils.h' 2023-11-23T10:47:06,908 adding 'deepspeed/inference/v2/kernels/includes/memory_access_utils.h' 2023-11-23T10:47:06,911 adding 'deepspeed/inference/v2/kernels/includes/reduction_utils.h' 2023-11-23T10:47:06,913 adding 'deepspeed/inference/v2/kernels/ragged_ops/__init__.py' 2023-11-23T10:47:06,914 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_ops.cpp' 2023-11-23T10:47:06,915 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/__init__.py' 2023-11-23T10:47:06,917 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.cpp' 2023-11-23T10:47:06,918 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.h' 2023-11-23T10:47:06,919 adding 'deepspeed/inference/v2/kernels/ragged_ops/atom_builder/atom_builder.py' 2023-11-23T10:47:06,921 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/__init__.py' 2023-11-23T10:47:06,922 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/attention_atom.h' 2023-11-23T10:47:06,923 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.cpp' 2023-11-23T10:47:06,925 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.h' 2023-11-23T10:47:06,926 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/blocked_flash.py' 2023-11-23T10:47:06,927 adding 'deepspeed/inference/v2/kernels/ragged_ops/blocked_flash/flash.h' 2023-11-23T10:47:06,929 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/__init__.py' 2023-11-23T10:47:06,931 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cpp' 2023-11-23T10:47:06,933 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cu' 2023-11-23T10:47:06,935 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.cuh' 2023-11-23T10:47:06,936 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.h' 2023-11-23T10:47:06,938 adding 'deepspeed/inference/v2/kernels/ragged_ops/embed/embed.py' 2023-11-23T10:47:06,941 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/__init__.py' 2023-11-23T10:47:06,942 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cpp' 2023-11-23T10:47:06,945 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cu' 2023-11-23T10:47:06,947 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.cuh' 2023-11-23T10:47:06,948 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.h' 2023-11-23T10:47:06,949 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_kv_rotary.py' 2023-11-23T10:47:06,950 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/blocked_trained_kv_rotary.py' 2023-11-23T10:47:06,952 adding 'deepspeed/inference/v2/kernels/ragged_ops/linear_blocked_kv_rotary/linear_blocked_kv_copy.py' 2023-11-23T10:47:06,954 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/__init__.py' 2023-11-23T10:47:06,955 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cpp' 2023-11-23T10:47:06,956 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cu' 2023-11-23T10:47:06,957 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.cuh' 2023-11-23T10:47:06,958 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.h' 2023-11-23T10:47:06,960 adding 'deepspeed/inference/v2/kernels/ragged_ops/logits_gather/logits_gather.py' 2023-11-23T10:47:06,961 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/__init__.py' 2023-11-23T10:47:06,963 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cpp' 2023-11-23T10:47:06,964 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cu' 2023-11-23T10:47:06,965 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.cuh' 2023-11-23T10:47:06,966 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.h' 2023-11-23T10:47:06,968 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_gather/moe_gather.py' 2023-11-23T10:47:06,969 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/__init__.py' 2023-11-23T10:47:06,971 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cpp' 2023-11-23T10:47:06,972 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cu' 2023-11-23T10:47:06,973 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.cuh' 2023-11-23T10:47:06,975 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.h' 2023-11-23T10:47:06,976 adding 'deepspeed/inference/v2/kernels/ragged_ops/moe_scatter/moe_scatter.py' 2023-11-23T10:47:06,978 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_dtypes.h' 2023-11-23T10:47:06,979 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.cpp' 2023-11-23T10:47:06,980 adding 'deepspeed/inference/v2/kernels/ragged_ops/ragged_helpers/ragged_kernel_helpers.h' 2023-11-23T10:47:06,982 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/__init__.py' 2023-11-23T10:47:06,983 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cpp' 2023-11-23T10:47:06,984 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cu' 2023-11-23T10:47:06,986 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.cuh' 2023-11-23T10:47:06,987 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.h' 2023-11-23T10:47:06,988 adding 'deepspeed/inference/v2/kernels/ragged_ops/top_1_gating/top_1_gating.py' 2023-11-23T10:47:06,990 adding 'deepspeed/inference/v2/model_implementations/__init__.py' 2023-11-23T10:47:06,992 adding 'deepspeed/inference/v2/model_implementations/inference_model_base.py' 2023-11-23T10:47:06,993 adding 'deepspeed/inference/v2/model_implementations/inference_policy_base.py' 2023-11-23T10:47:06,996 adding 'deepspeed/inference/v2/model_implementations/inference_transformer_base.py' 2023-11-23T10:47:06,998 adding 'deepspeed/inference/v2/model_implementations/layer_container_base.py' 2023-11-23T10:47:07,000 adding 'deepspeed/inference/v2/model_implementations/parameter_base.py' 2023-11-23T10:47:07,002 adding 'deepspeed/inference/v2/model_implementations/common_parameters/__init__.py' 2023-11-23T10:47:07,003 adding 'deepspeed/inference/v2/model_implementations/common_parameters/attn_output_parameters.py' 2023-11-23T10:47:07,004 adding 'deepspeed/inference/v2/model_implementations/common_parameters/embedding_parameters.py' 2023-11-23T10:47:07,006 adding 'deepspeed/inference/v2/model_implementations/common_parameters/invfreq_parameters.py' 2023-11-23T10:47:07,007 adding 'deepspeed/inference/v2/model_implementations/common_parameters/mlp_parameters.py' 2023-11-23T10:47:07,008 adding 'deepspeed/inference/v2/model_implementations/common_parameters/moe_parameters.py' 2023-11-23T10:47:07,009 adding 'deepspeed/inference/v2/model_implementations/common_parameters/norm_parameters.py' 2023-11-23T10:47:07,011 adding 'deepspeed/inference/v2/model_implementations/common_parameters/qkv_parameters.py' 2023-11-23T10:47:07,012 adding 'deepspeed/inference/v2/model_implementations/common_parameters/unembed_parameters.py' 2023-11-23T10:47:07,014 adding 'deepspeed/inference/v2/model_implementations/llama_v2/__init__.py' 2023-11-23T10:47:07,015 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_containers.py' 2023-11-23T10:47:07,016 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_model.py' 2023-11-23T10:47:07,018 adding 'deepspeed/inference/v2/model_implementations/llama_v2/llama_v2_policy.py' 2023-11-23T10:47:07,019 adding 'deepspeed/inference/v2/model_implementations/mistral/__init__.py' 2023-11-23T10:47:07,020 adding 'deepspeed/inference/v2/model_implementations/mistral/container.py' 2023-11-23T10:47:07,022 adding 'deepspeed/inference/v2/model_implementations/mistral/model.py' 2023-11-23T10:47:07,023 adding 'deepspeed/inference/v2/model_implementations/mistral/policy.py' 2023-11-23T10:47:07,025 adding 'deepspeed/inference/v2/model_implementations/opt/__init__.py' 2023-11-23T10:47:07,026 adding 'deepspeed/inference/v2/model_implementations/opt/container.py' 2023-11-23T10:47:07,028 adding 'deepspeed/inference/v2/model_implementations/opt/model.py' 2023-11-23T10:47:07,029 adding 'deepspeed/inference/v2/model_implementations/opt/policy.py' 2023-11-23T10:47:07,031 adding 'deepspeed/inference/v2/model_implementations/sharding/__init__.py' 2023-11-23T10:47:07,032 adding 'deepspeed/inference/v2/model_implementations/sharding/attn.py' 2023-11-23T10:47:07,033 adding 'deepspeed/inference/v2/model_implementations/sharding/attn_out.py' 2023-11-23T10:47:07,035 adding 'deepspeed/inference/v2/model_implementations/sharding/embedding.py' 2023-11-23T10:47:07,036 adding 'deepspeed/inference/v2/model_implementations/sharding/mlp.py' 2023-11-23T10:47:07,038 adding 'deepspeed/inference/v2/model_implementations/sharding/qkv.py' 2023-11-23T10:47:07,039 adding 'deepspeed/inference/v2/model_implementations/sharding/types.py' 2023-11-23T10:47:07,040 adding 'deepspeed/inference/v2/model_implementations/sharding/unembed.py' 2023-11-23T10:47:07,042 adding 'deepspeed/inference/v2/model_implementations/sharding/utils.py' 2023-11-23T10:47:07,043 adding 'deepspeed/inference/v2/modules/__init__.py' 2023-11-23T10:47:07,045 adding 'deepspeed/inference/v2/modules/ds_module.py' 2023-11-23T10:47:07,046 adding 'deepspeed/inference/v2/modules/heuristics.py' 2023-11-23T10:47:07,047 adding 'deepspeed/inference/v2/modules/module_registry.py' 2023-11-23T10:47:07,049 adding 'deepspeed/inference/v2/modules/configs/__init__.py' 2023-11-23T10:47:07,051 adding 'deepspeed/inference/v2/modules/configs/attention_configs.py' 2023-11-23T10:47:07,052 adding 'deepspeed/inference/v2/modules/configs/embedding_config.py' 2023-11-23T10:47:07,053 adding 'deepspeed/inference/v2/modules/configs/linear_config.py' 2023-11-23T10:47:07,055 adding 'deepspeed/inference/v2/modules/configs/moe_config.py' 2023-11-23T10:47:07,056 adding 'deepspeed/inference/v2/modules/configs/norm_config.py' 2023-11-23T10:47:07,057 adding 'deepspeed/inference/v2/modules/configs/unembed_config.py' 2023-11-23T10:47:07,059 adding 'deepspeed/inference/v2/modules/implementations/__init__.py' 2023-11-23T10:47:07,061 adding 'deepspeed/inference/v2/modules/implementations/attention/__init__.py' 2023-11-23T10:47:07,062 adding 'deepspeed/inference/v2/modules/implementations/attention/dense_blocked_attention.py' 2023-11-23T10:47:07,064 adding 'deepspeed/inference/v2/modules/implementations/embedding/__init__.py' 2023-11-23T10:47:07,065 adding 'deepspeed/inference/v2/modules/implementations/embedding/ragged_embedding.py' 2023-11-23T10:47:07,067 adding 'deepspeed/inference/v2/modules/implementations/linear/__init__.py' 2023-11-23T10:47:07,069 adding 'deepspeed/inference/v2/modules/implementations/linear/blas_fp_linear.py' 2023-11-23T10:47:07,070 adding 'deepspeed/inference/v2/modules/implementations/linear/cutlass_fp_linear.py' 2023-11-23T10:47:07,072 adding 'deepspeed/inference/v2/modules/implementations/moe/__init__.py' 2023-11-23T10:47:07,073 adding 'deepspeed/inference/v2/modules/implementations/moe/cutlass_multi_gemm.py' 2023-11-23T10:47:07,075 adding 'deepspeed/inference/v2/modules/implementations/moe/gate_fn.py' 2023-11-23T10:47:07,076 adding 'deepspeed/inference/v2/modules/implementations/moe/test.py' 2023-11-23T10:47:07,078 adding 'deepspeed/inference/v2/modules/implementations/post_norm/__init__.py' 2023-11-23T10:47:07,079 adding 'deepspeed/inference/v2/modules/implementations/post_norm/cuda_post_ln.py' 2023-11-23T10:47:07,081 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/__init__.py' 2023-11-23T10:47:07,082 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_ln.py' 2023-11-23T10:47:07,083 adding 'deepspeed/inference/v2/modules/implementations/pre_norm/cuda_pre_rms.py' 2023-11-23T10:47:07,085 adding 'deepspeed/inference/v2/modules/implementations/unembed/__init__.py' 2023-11-23T10:47:07,087 adding 'deepspeed/inference/v2/modules/implementations/unembed/ragged_unembed.py' 2023-11-23T10:47:07,089 adding 'deepspeed/inference/v2/modules/interfaces/__init__.py' 2023-11-23T10:47:07,090 adding 'deepspeed/inference/v2/modules/interfaces/attention_base.py' 2023-11-23T10:47:07,091 adding 'deepspeed/inference/v2/modules/interfaces/embedding_base.py' 2023-11-23T10:47:07,093 adding 'deepspeed/inference/v2/modules/interfaces/linear_base.py' 2023-11-23T10:47:07,094 adding 'deepspeed/inference/v2/modules/interfaces/moe_base.py' 2023-11-23T10:47:07,095 adding 'deepspeed/inference/v2/modules/interfaces/post_norm_base.py' 2023-11-23T10:47:07,096 adding 'deepspeed/inference/v2/modules/interfaces/pre_norm_base.py' 2023-11-23T10:47:07,098 adding 'deepspeed/inference/v2/modules/interfaces/unembed_base.py' 2023-11-23T10:47:07,099 adding 'deepspeed/inference/v2/ragged/__init__.py' 2023-11-23T10:47:07,101 adding 'deepspeed/inference/v2/ragged/blocked_allocator.py' 2023-11-23T10:47:07,103 adding 'deepspeed/inference/v2/ragged/kv_cache.py' 2023-11-23T10:47:07,104 adding 'deepspeed/inference/v2/ragged/manager_configs.py' 2023-11-23T10:47:07,106 adding 'deepspeed/inference/v2/ragged/ragged_manager.py' 2023-11-23T10:47:07,108 adding 'deepspeed/inference/v2/ragged/ragged_wrapper.py' 2023-11-23T10:47:07,109 adding 'deepspeed/inference/v2/ragged/sequence_descriptor.py' 2023-11-23T10:47:07,111 adding 'deepspeed/inference/v2/ragged/csrc/fast_host_buffer.cu' 2023-11-23T10:47:07,113 adding 'deepspeed/inference/v2/ragged/csrc/ragged_ops.cpp' 2023-11-23T10:47:07,114 adding 'deepspeed/inference/v2/ragged/includes/fast_host_buffer.h' 2023-11-23T10:47:07,116 adding 'deepspeed/launcher/__init__.py' 2023-11-23T10:47:07,117 adding 'deepspeed/launcher/constants.py' 2023-11-23T10:47:07,119 adding 'deepspeed/launcher/launch.py' 2023-11-23T10:47:07,121 adding 'deepspeed/launcher/multinode_runner.py' 2023-11-23T10:47:07,124 adding 'deepspeed/launcher/runner.py' 2023-11-23T10:47:07,126 adding 'deepspeed/model_implementations/__init__.py' 2023-11-23T10:47:07,128 adding 'deepspeed/model_implementations/diffusers/__init__.py' 2023-11-23T10:47:07,129 adding 'deepspeed/model_implementations/diffusers/unet.py' 2023-11-23T10:47:07,131 adding 'deepspeed/model_implementations/diffusers/vae.py' 2023-11-23T10:47:07,132 adding 'deepspeed/model_implementations/features/__init__.py' 2023-11-23T10:47:07,134 adding 'deepspeed/model_implementations/features/cuda_graph.py' 2023-11-23T10:47:07,135 adding 'deepspeed/model_implementations/transformers/__init__.py' 2023-11-23T10:47:07,137 adding 'deepspeed/model_implementations/transformers/clip_encoder.py' 2023-11-23T10:47:07,138 adding 'deepspeed/model_implementations/transformers/ds_base.py' 2023-11-23T10:47:07,139 adding 'deepspeed/model_implementations/transformers/ds_bert.py' 2023-11-23T10:47:07,140 adding 'deepspeed/model_implementations/transformers/ds_bloom.py' 2023-11-23T10:47:07,141 adding 'deepspeed/model_implementations/transformers/ds_gpt.py' 2023-11-23T10:47:07,143 adding 'deepspeed/model_implementations/transformers/ds_llama2.py' 2023-11-23T10:47:07,144 adding 'deepspeed/model_implementations/transformers/ds_megatron_gpt.py' 2023-11-23T10:47:07,145 adding 'deepspeed/model_implementations/transformers/ds_opt.py' 2023-11-23T10:47:07,147 adding 'deepspeed/model_implementations/transformers/ds_transformer.py' 2023-11-23T10:47:07,149 adding 'deepspeed/module_inject/__init__.py' 2023-11-23T10:47:07,151 adding 'deepspeed/module_inject/auto_tp.py' 2023-11-23T10:47:07,153 adding 'deepspeed/module_inject/auto_tp_model_utils.py' 2023-11-23T10:47:07,154 adding 'deepspeed/module_inject/fusedqkv_utils.py' 2023-11-23T10:47:07,156 adding 'deepspeed/module_inject/inject.py' 2023-11-23T10:47:07,157 adding 'deepspeed/module_inject/layers.py' 2023-11-23T10:47:07,159 adding 'deepspeed/module_inject/load_checkpoint.py' 2023-11-23T10:47:07,160 adding 'deepspeed/module_inject/module_quantize.py' 2023-11-23T10:47:07,162 adding 'deepspeed/module_inject/policy.py' 2023-11-23T10:47:07,165 adding 'deepspeed/module_inject/replace_module.py' 2023-11-23T10:47:07,167 adding 'deepspeed/module_inject/replace_policy.py' 2023-11-23T10:47:07,168 adding 'deepspeed/module_inject/tp_shard.py' 2023-11-23T10:47:07,169 adding 'deepspeed/module_inject/utils.py' 2023-11-23T10:47:07,171 adding 'deepspeed/module_inject/containers/__init__.py' 2023-11-23T10:47:07,173 adding 'deepspeed/module_inject/containers/base.py' 2023-11-23T10:47:07,174 adding 'deepspeed/module_inject/containers/base_moe.py' 2023-11-23T10:47:07,175 adding 'deepspeed/module_inject/containers/bert.py' 2023-11-23T10:47:07,177 adding 'deepspeed/module_inject/containers/bloom.py' 2023-11-23T10:47:07,178 adding 'deepspeed/module_inject/containers/clip.py' 2023-11-23T10:47:07,179 adding 'deepspeed/module_inject/containers/distil_bert.py' 2023-11-23T10:47:07,181 adding 'deepspeed/module_inject/containers/gpt2.py' 2023-11-23T10:47:07,182 adding 'deepspeed/module_inject/containers/gptj.py' 2023-11-23T10:47:07,184 adding 'deepspeed/module_inject/containers/gptneo.py' 2023-11-23T10:47:07,185 adding 'deepspeed/module_inject/containers/gptneox.py' 2023-11-23T10:47:07,187 adding 'deepspeed/module_inject/containers/internlm.py' 2023-11-23T10:47:07,188 adding 'deepspeed/module_inject/containers/llama.py' 2023-11-23T10:47:07,190 adding 'deepspeed/module_inject/containers/llama2.py' 2023-11-23T10:47:07,191 adding 'deepspeed/module_inject/containers/megatron_gpt.py' 2023-11-23T10:47:07,193 adding 'deepspeed/module_inject/containers/megatron_gpt_moe.py' 2023-11-23T10:47:07,194 adding 'deepspeed/module_inject/containers/opt.py' 2023-11-23T10:47:07,195 adding 'deepspeed/module_inject/containers/unet.py' 2023-11-23T10:47:07,197 adding 'deepspeed/module_inject/containers/vae.py' 2023-11-23T10:47:07,198 adding 'deepspeed/module_inject/containers/features/__init__.py' 2023-11-23T10:47:07,200 adding 'deepspeed/module_inject/containers/features/gated_mlp.py' 2023-11-23T10:47:07,202 adding 'deepspeed/module_inject/containers/features/hybrid_engine.py' 2023-11-23T10:47:07,203 adding 'deepspeed/module_inject/containers/features/hybrid_megatron.py' 2023-11-23T10:47:07,204 adding 'deepspeed/module_inject/containers/features/megatron.py' 2023-11-23T10:47:07,206 adding 'deepspeed/module_inject/containers/features/meta_tensor.py' 2023-11-23T10:47:07,207 adding 'deepspeed/module_inject/containers/features/split_qkv.py' 2023-11-23T10:47:07,209 adding 'deepspeed/moe/__init__.py' 2023-11-23T10:47:07,210 adding 'deepspeed/moe/experts.py' 2023-11-23T10:47:07,212 adding 'deepspeed/moe/layer.py' 2023-11-23T10:47:07,213 adding 'deepspeed/moe/mappings.py' 2023-11-23T10:47:07,216 adding 'deepspeed/moe/sharded_moe.py' 2023-11-23T10:47:07,217 adding 'deepspeed/moe/utils.py' 2023-11-23T10:47:07,219 adding 'deepspeed/monitor/__init__.py' 2023-11-23T10:47:07,220 adding 'deepspeed/monitor/config.py' 2023-11-23T10:47:07,222 adding 'deepspeed/monitor/csv_monitor.py' 2023-11-23T10:47:07,223 adding 'deepspeed/monitor/monitor.py' 2023-11-23T10:47:07,224 adding 'deepspeed/monitor/tensorboard.py' 2023-11-23T10:47:07,225 adding 'deepspeed/monitor/utils.py' 2023-11-23T10:47:07,226 adding 'deepspeed/monitor/wandb.py' 2023-11-23T10:47:07,228 adding 'deepspeed/nebula/__init__.py' 2023-11-23T10:47:07,229 adding 'deepspeed/nebula/config.py' 2023-11-23T10:47:07,230 adding 'deepspeed/nebula/constants.py' 2023-11-23T10:47:07,232 adding 'deepspeed/ops/__init__.py' 2023-11-23T10:47:07,234 adding 'deepspeed/ops/adagrad/__init__.py' 2023-11-23T10:47:07,235 adding 'deepspeed/ops/adagrad/cpu_adagrad.py' 2023-11-23T10:47:07,236 adding 'deepspeed/ops/adam/__init__.py' 2023-11-23T10:47:07,238 adding 'deepspeed/ops/adam/cpu_adam.py' 2023-11-23T10:47:07,240 adding 'deepspeed/ops/adam/fused_adam.py' 2023-11-23T10:47:07,241 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2023-11-23T10:47:07,242 adding 'deepspeed/ops/aio/__init__.py' 2023-11-23T10:47:07,245 adding 'deepspeed/ops/csrc/adagrad/cpu_adagrad.cpp' 2023-11-23T10:47:07,247 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2023-11-23T10:47:07,248 adding 'deepspeed/ops/csrc/adam/cpu_adam_impl.cpp' 2023-11-23T10:47:07,249 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2023-11-23T10:47:07,251 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2023-11-23T10:47:07,252 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2023-11-23T10:47:07,255 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2023-11-23T10:47:07,256 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2023-11-23T10:47:07,257 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2023-11-23T10:47:07,258 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2023-11-23T10:47:07,260 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2023-11-23T10:47:07,261 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2023-11-23T10:47:07,263 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2023-11-23T10:47:07,264 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2023-11-23T10:47:07,265 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.cpp' 2023-11-23T10:47:07,267 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_pin_tensor.h' 2023-11-23T10:47:07,268 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2023-11-23T10:47:07,269 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2023-11-23T10:47:07,271 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2023-11-23T10:47:07,272 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2023-11-23T10:47:07,273 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2023-11-23T10:47:07,275 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2023-11-23T10:47:07,276 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2023-11-23T10:47:07,278 adding 'deepspeed/ops/csrc/aio/py_test/single_process_config.json' 2023-11-23T10:47:07,279 adding 'deepspeed/ops/csrc/common/custom_cuda_kernel.cu' 2023-11-23T10:47:07,281 adding 'deepspeed/ops/csrc/cpu/adam/fused_adam.cpp' 2023-11-23T10:47:07,284 adding 'deepspeed/ops/csrc/cpu/comm/ccl.cpp' 2023-11-23T10:47:07,286 adding 'deepspeed/ops/csrc/cpu/lion/fused_lion.cpp' 2023-11-23T10:47:07,288 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention.cpp' 2023-11-23T10:47:07,290 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_back.cu' 2023-11-23T10:47:07,292 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/attention_cu.cu' 2023-11-23T10:47:07,293 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h' 2023-11-23T10:47:07,302 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_backward.h' 2023-11-23T10:47:07,307 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/kernel_forward.h' 2023-11-23T10:47:07,309 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_grad_bias.h' 2023-11-23T10:47:07,312 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_pipelined.h' 2023-11-23T10:47:07,314 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_rescale_output.h' 2023-11-23T10:47:07,315 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/epilogue/epilogue_thread_apply_logsumexp.h' 2023-11-23T10:47:07,317 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma.h' 2023-11-23T10:47:07,319 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_base.h' 2023-11-23T10:47:07,321 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_multistage.h' 2023-11-23T10:47:07,324 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/custom_mma_pipelined.h' 2023-11-23T10:47:07,325 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/find_default_mma.h' 2023-11-23T10:47:07,327 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_accum_lambda_iterator.h' 2023-11-23T10:47:07,335 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm/mma_from_smem.h' 2023-11-23T10:47:07,338 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/epilogue_predicated_tile_iterator.h' 2023-11-23T10:47:07,340 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/make_residual_last.h' 2023-11-23T10:47:07,344 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_access_iterator_residual_last.h' 2023-11-23T10:47:07,347 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_atomic.h' 2023-11-23T10:47:07,351 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/predicated_tile_iterator_residual_last.h' 2023-11-23T10:47:07,353 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/transpose_warp_iterator.h' 2023-11-23T10:47:07,355 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/iterators/warp_iterator_from_smem.h' 2023-11-23T10:47:07,357 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/bias_broadcast.h' 2023-11-23T10:47:07,359 adding 'deepspeed/ops/csrc/deepspeed4science/evoformer_attn/transform/tile_smem_loader.h' 2023-11-23T10:47:07,361 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2023-11-23T10:47:07,362 adding 'deepspeed/ops/csrc/includes/Timer.h' 2023-11-23T10:47:07,363 adding 'deepspeed/ops/csrc/includes/activation_type.h' 2023-11-23T10:47:07,365 adding 'deepspeed/ops/csrc/includes/compat.h' 2023-11-23T10:47:07,366 adding 'deepspeed/ops/csrc/includes/context.h' 2023-11-23T10:47:07,368 adding 'deepspeed/ops/csrc/includes/conversion_utils.h' 2023-11-23T10:47:07,369 adding 'deepspeed/ops/csrc/includes/cpu_adagrad.h' 2023-11-23T10:47:07,371 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2023-11-23T10:47:07,373 adding 'deepspeed/ops/csrc/includes/cpu_lion.h' 2023-11-23T10:47:07,374 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2023-11-23T10:47:07,376 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2023-11-23T10:47:07,378 adding 'deepspeed/ops/csrc/includes/dequantization_utils.h' 2023-11-23T10:47:07,379 adding 'deepspeed/ops/csrc/includes/dropout.h' 2023-11-23T10:47:07,380 adding 'deepspeed/ops/csrc/includes/ds_kernel_utils.h' 2023-11-23T10:47:07,382 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2023-11-23T10:47:07,383 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2023-11-23T10:47:07,384 adding 'deepspeed/ops/csrc/includes/gelu.h' 2023-11-23T10:47:07,386 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2023-11-23T10:47:07,387 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2023-11-23T10:47:07,390 adding 'deepspeed/ops/csrc/includes/memory_access_utils.h' 2023-11-23T10:47:07,391 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2023-11-23T10:47:07,393 adding 'deepspeed/ops/csrc/includes/quantization.h' 2023-11-23T10:47:07,395 adding 'deepspeed/ops/csrc/includes/quantization_utils.h' 2023-11-23T10:47:07,396 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2023-11-23T10:47:07,398 adding 'deepspeed/ops/csrc/includes/reduction_utils.h' 2023-11-23T10:47:07,400 adding 'deepspeed/ops/csrc/includes/simd.h' 2023-11-23T10:47:07,401 adding 'deepspeed/ops/csrc/includes/softmax.h' 2023-11-23T10:47:07,402 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2023-11-23T10:47:07,404 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2023-11-23T10:47:07,405 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2023-11-23T10:47:07,407 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2023-11-23T10:47:07,409 adding 'deepspeed/ops/csrc/lion/cpu_lion.cpp' 2023-11-23T10:47:07,411 adding 'deepspeed/ops/csrc/lion/cpu_lion_impl.cpp' 2023-11-23T10:47:07,412 adding 'deepspeed/ops/csrc/lion/fused_lion_frontend.cpp' 2023-11-23T10:47:07,413 adding 'deepspeed/ops/csrc/lion/multi_tensor_apply.cuh' 2023-11-23T10:47:07,415 adding 'deepspeed/ops/csrc/lion/multi_tensor_lion.cu' 2023-11-23T10:47:07,416 adding 'deepspeed/ops/csrc/quantization/dequantize.cu' 2023-11-23T10:47:07,419 adding 'deepspeed/ops/csrc/quantization/fake_quantizer.cu' 2023-11-23T10:47:07,421 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2023-11-23T10:47:07,423 adding 'deepspeed/ops/csrc/quantization/quant_reduce.cu' 2023-11-23T10:47:07,424 adding 'deepspeed/ops/csrc/quantization/quantize.cu' 2023-11-23T10:47:07,426 adding 'deepspeed/ops/csrc/quantization/quantize_intX.cu' 2023-11-23T10:47:07,427 adding 'deepspeed/ops/csrc/quantization/swizzled_quantize.cu' 2023-11-23T10:47:07,429 adding 'deepspeed/ops/csrc/random_ltd/gather_scatter.cu' 2023-11-23T10:47:07,431 adding 'deepspeed/ops/csrc/random_ltd/pt_binding.cpp' 2023-11-23T10:47:07,432 adding 'deepspeed/ops/csrc/random_ltd/slice_attn_masks.cu' 2023-11-23T10:47:07,434 adding 'deepspeed/ops/csrc/random_ltd/token_sort.cu' 2023-11-23T10:47:07,436 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2023-11-23T10:47:07,438 adding 'deepspeed/ops/csrc/spatial/csrc/opt_bias_add.cu' 2023-11-23T10:47:07,439 adding 'deepspeed/ops/csrc/spatial/csrc/pt_binding.cpp' 2023-11-23T10:47:07,441 adding 'deepspeed/ops/csrc/spatial/includes/spatial_cuda_layers.h' 2023-11-23T10:47:07,443 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2023-11-23T10:47:07,446 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2023-11-23T10:47:07,450 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2023-11-23T10:47:07,452 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2023-11-23T10:47:07,453 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2023-11-23T10:47:07,458 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2023-11-23T10:47:07,460 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2023-11-23T10:47:07,463 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2023-11-23T10:47:07,466 adding 'deepspeed/ops/csrc/transformer/inference/csrc/apply_rotary_pos_emb.cu' 2023-11-23T10:47:07,467 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2023-11-23T10:47:07,470 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2023-11-23T10:47:07,472 adding 'deepspeed/ops/csrc/transformer/inference/csrc/layer_norm.cu' 2023-11-23T10:47:07,474 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pointwise_ops.cu' 2023-11-23T10:47:07,479 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2023-11-23T10:47:07,481 adding 'deepspeed/ops/csrc/transformer/inference/csrc/relu.cu' 2023-11-23T10:47:07,483 adding 'deepspeed/ops/csrc/transformer/inference/csrc/rms_norm.cu' 2023-11-23T10:47:07,485 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2023-11-23T10:47:07,488 adding 'deepspeed/ops/csrc/transformer/inference/csrc/transform.cu' 2023-11-23T10:47:07,491 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_context.h' 2023-11-23T10:47:07,492 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cublas_wrappers.h' 2023-11-23T10:47:07,494 adding 'deepspeed/ops/csrc/transformer/inference/includes/inference_cuda_layers.h' 2023-11-23T10:47:07,496 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2023-11-23T10:47:07,497 adding 'deepspeed/ops/deepspeed4science/__init__.py' 2023-11-23T10:47:07,498 adding 'deepspeed/ops/deepspeed4science/evoformer_attn.py' 2023-11-23T10:47:07,500 adding 'deepspeed/ops/lamb/__init__.py' 2023-11-23T10:47:07,501 adding 'deepspeed/ops/lamb/fused_lamb.py' 2023-11-23T10:47:07,503 adding 'deepspeed/ops/lion/__init__.py' 2023-11-23T10:47:07,504 adding 'deepspeed/ops/lion/cpu_lion.py' 2023-11-23T10:47:07,506 adding 'deepspeed/ops/lion/fused_lion.py' 2023-11-23T10:47:07,507 adding 'deepspeed/ops/lion/multi_tensor_apply.py' 2023-11-23T10:47:07,509 adding 'deepspeed/ops/op_builder/__init__.py' 2023-11-23T10:47:07,510 adding 'deepspeed/ops/op_builder/all_ops.py' 2023-11-23T10:47:07,511 adding 'deepspeed/ops/op_builder/async_io.py' 2023-11-23T10:47:07,515 adding 'deepspeed/ops/op_builder/builder.py' 2023-11-23T10:47:07,516 adding 'deepspeed/ops/op_builder/cpu_adagrad.py' 2023-11-23T10:47:07,517 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2023-11-23T10:47:07,519 adding 'deepspeed/ops/op_builder/cpu_lion.py' 2023-11-23T10:47:07,520 adding 'deepspeed/ops/op_builder/evoformer_attn.py' 2023-11-23T10:47:07,521 adding 'deepspeed/ops/op_builder/fused_adam.py' 2023-11-23T10:47:07,522 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2023-11-23T10:47:07,523 adding 'deepspeed/ops/op_builder/fused_lion.py' 2023-11-23T10:47:07,525 adding 'deepspeed/ops/op_builder/inference_core_ops.py' 2023-11-23T10:47:07,526 adding 'deepspeed/ops/op_builder/inference_cutlass_builder.py' 2023-11-23T10:47:07,527 adding 'deepspeed/ops/op_builder/quantizer.py' 2023-11-23T10:47:07,529 adding 'deepspeed/ops/op_builder/ragged_ops.py' 2023-11-23T10:47:07,530 adding 'deepspeed/ops/op_builder/ragged_utils.py' 2023-11-23T10:47:07,531 adding 'deepspeed/ops/op_builder/random_ltd.py' 2023-11-23T10:47:07,532 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2023-11-23T10:47:07,533 adding 'deepspeed/ops/op_builder/spatial_inference.py' 2023-11-23T10:47:07,535 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2023-11-23T10:47:07,536 adding 'deepspeed/ops/op_builder/transformer.py' 2023-11-23T10:47:07,537 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2023-11-23T10:47:07,539 adding 'deepspeed/ops/op_builder/cpu/__init__.py' 2023-11-23T10:47:07,540 adding 'deepspeed/ops/op_builder/cpu/builder.py' 2023-11-23T10:47:07,541 adding 'deepspeed/ops/op_builder/cpu/comm.py' 2023-11-23T10:47:07,543 adding 'deepspeed/ops/op_builder/cpu/cpu_adam.py' 2023-11-23T10:47:07,544 adding 'deepspeed/ops/op_builder/cpu/fused_adam.py' 2023-11-23T10:47:07,545 adding 'deepspeed/ops/op_builder/cpu/no_impl.py' 2023-11-23T10:47:07,547 adding 'deepspeed/ops/op_builder/npu/__init__.py' 2023-11-23T10:47:07,548 adding 'deepspeed/ops/op_builder/npu/builder.py' 2023-11-23T10:47:07,549 adding 'deepspeed/ops/op_builder/npu/fused_adam.py' 2023-11-23T10:47:07,551 adding 'deepspeed/ops/op_builder/npu/no_impl.py' 2023-11-23T10:47:07,552 adding 'deepspeed/ops/quantizer/__init__.py' 2023-11-23T10:47:07,553 adding 'deepspeed/ops/quantizer/quantizer.py' 2023-11-23T10:47:07,555 adding 'deepspeed/ops/random_ltd/__init__.py' 2023-11-23T10:47:07,557 adding 'deepspeed/ops/random_ltd/dropping_utils.py' 2023-11-23T10:47:07,558 adding 'deepspeed/ops/sparse_attention/__init__.py' 2023-11-23T10:47:07,560 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2023-11-23T10:47:07,563 adding 'deepspeed/ops/sparse_attention/matmul.py' 2023-11-23T10:47:07,566 adding 'deepspeed/ops/sparse_attention/softmax.py' 2023-11-23T10:47:07,568 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2023-11-23T10:47:07,570 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2023-11-23T10:47:07,573 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2023-11-23T10:47:07,575 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2023-11-23T10:47:07,576 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2023-11-23T10:47:07,577 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2023-11-23T10:47:07,579 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2023-11-23T10:47:07,580 adding 'deepspeed/ops/transformer/__init__.py' 2023-11-23T10:47:07,583 adding 'deepspeed/ops/transformer/transformer.py' 2023-11-23T10:47:07,584 adding 'deepspeed/ops/transformer/inference/__init__.py' 2023-11-23T10:47:07,585 adding 'deepspeed/ops/transformer/inference/bias_add.py' 2023-11-23T10:47:07,587 adding 'deepspeed/ops/transformer/inference/config.py' 2023-11-23T10:47:07,588 adding 'deepspeed/ops/transformer/inference/diffusers_2d_transformer.py' 2023-11-23T10:47:07,589 adding 'deepspeed/ops/transformer/inference/diffusers_attention.py' 2023-11-23T10:47:07,591 adding 'deepspeed/ops/transformer/inference/diffusers_transformer_block.py' 2023-11-23T10:47:07,593 adding 'deepspeed/ops/transformer/inference/ds_attention.py' 2023-11-23T10:47:07,594 adding 'deepspeed/ops/transformer/inference/ds_mlp.py' 2023-11-23T10:47:07,597 adding 'deepspeed/ops/transformer/inference/moe_inference.py' 2023-11-23T10:47:07,598 adding 'deepspeed/ops/transformer/inference/triton_ops.py' 2023-11-23T10:47:07,600 adding 'deepspeed/ops/transformer/inference/op_binding/__init__.py' 2023-11-23T10:47:07,601 adding 'deepspeed/ops/transformer/inference/op_binding/base.py' 2023-11-23T10:47:07,602 adding 'deepspeed/ops/transformer/inference/op_binding/gelu_gemm.py' 2023-11-23T10:47:07,603 adding 'deepspeed/ops/transformer/inference/op_binding/linear.py' 2023-11-23T10:47:07,605 adding 'deepspeed/ops/transformer/inference/op_binding/mlp_gemm.py' 2023-11-23T10:47:07,606 adding 'deepspeed/ops/transformer/inference/op_binding/qkv_gemm.py' 2023-11-23T10:47:07,607 adding 'deepspeed/ops/transformer/inference/op_binding/residual_add.py' 2023-11-23T10:47:07,609 adding 'deepspeed/ops/transformer/inference/op_binding/softmax.py' 2023-11-23T10:47:07,610 adding 'deepspeed/ops/transformer/inference/op_binding/softmax_context.py' 2023-11-23T10:47:07,611 adding 'deepspeed/ops/transformer/inference/op_binding/vector_matmul.py' 2023-11-23T10:47:07,613 adding 'deepspeed/ops/transformer/inference/triton/__init__.py' 2023-11-23T10:47:07,615 adding 'deepspeed/ops/transformer/inference/triton/attention.py' 2023-11-23T10:47:07,617 adding 'deepspeed/ops/transformer/inference/triton/gelu.py' 2023-11-23T10:47:07,618 adding 'deepspeed/ops/transformer/inference/triton/layer_norm.py' 2023-11-23T10:47:07,620 adding 'deepspeed/ops/transformer/inference/triton/matmul_ext.py' 2023-11-23T10:47:07,621 adding 'deepspeed/ops/transformer/inference/triton/mlp.py' 2023-11-23T10:47:07,623 adding 'deepspeed/ops/transformer/inference/triton/ops.py' 2023-11-23T10:47:07,624 adding 'deepspeed/ops/transformer/inference/triton/residual_add.py' 2023-11-23T10:47:07,625 adding 'deepspeed/ops/transformer/inference/triton/softmax.py' 2023-11-23T10:47:07,627 adding 'deepspeed/ops/transformer/inference/triton/triton_matmul_kernel.py' 2023-11-23T10:47:07,629 adding 'deepspeed/pipe/__init__.py' 2023-11-23T10:47:07,630 adding 'deepspeed/profiling/__init__.py' 2023-11-23T10:47:07,632 adding 'deepspeed/profiling/config.py' 2023-11-23T10:47:07,633 adding 'deepspeed/profiling/constants.py' 2023-11-23T10:47:07,635 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2023-11-23T10:47:07,640 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2023-11-23T10:47:07,642 adding 'deepspeed/runtime/__init__.py' 2023-11-23T10:47:07,644 adding 'deepspeed/runtime/bf16_optimizer.py' 2023-11-23T10:47:07,649 adding 'deepspeed/runtime/config.py' 2023-11-23T10:47:07,651 adding 'deepspeed/runtime/config_utils.py' 2023-11-23T10:47:07,653 adding 'deepspeed/runtime/constants.py' 2023-11-23T10:47:07,654 adding 'deepspeed/runtime/dataloader.py' 2023-11-23T10:47:07,656 adding 'deepspeed/runtime/eigenvalue.py' 2023-11-23T10:47:07,673 adding 'deepspeed/runtime/engine.py' 2023-11-23T10:47:07,677 adding 'deepspeed/runtime/hybrid_engine.py' 2023-11-23T10:47:07,681 adding 'deepspeed/runtime/lr_schedules.py' 2023-11-23T10:47:07,683 adding 'deepspeed/runtime/progressive_layer_drop.py' 2023-11-23T10:47:07,684 adding 'deepspeed/runtime/quantize.py' 2023-11-23T10:47:07,685 adding 'deepspeed/runtime/sparse_tensor.py' 2023-11-23T10:47:07,687 adding 'deepspeed/runtime/state_dict_factory.py' 2023-11-23T10:47:07,692 adding 'deepspeed/runtime/utils.py' 2023-11-23T10:47:07,694 adding 'deepspeed/runtime/weight_quantizer.py' 2023-11-23T10:47:07,696 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2023-11-23T10:47:07,700 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2023-11-23T10:47:07,702 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2023-11-23T10:47:07,704 adding 'deepspeed/runtime/checkpoint_engine/__init__.py' 2023-11-23T10:47:07,705 adding 'deepspeed/runtime/checkpoint_engine/checkpoint_engine.py' 2023-11-23T10:47:07,706 adding 'deepspeed/runtime/checkpoint_engine/nebula_checkpoint_engine.py' 2023-11-23T10:47:07,707 adding 'deepspeed/runtime/checkpoint_engine/torch_checkpoint_engine.py' 2023-11-23T10:47:07,709 adding 'deepspeed/runtime/comm/__init__.py' 2023-11-23T10:47:07,710 adding 'deepspeed/runtime/comm/coalesced_collectives.py' 2023-11-23T10:47:07,712 adding 'deepspeed/runtime/comm/mpi.py' 2023-11-23T10:47:07,714 adding 'deepspeed/runtime/comm/nccl.py' 2023-11-23T10:47:07,715 adding 'deepspeed/runtime/compression/__init__.py' 2023-11-23T10:47:07,717 adding 'deepspeed/runtime/compression/cupy.py' 2023-11-23T10:47:07,718 adding 'deepspeed/runtime/data_pipeline/__init__.py' 2023-11-23T10:47:07,720 adding 'deepspeed/runtime/data_pipeline/config.py' 2023-11-23T10:47:07,721 adding 'deepspeed/runtime/data_pipeline/constants.py' 2023-11-23T10:47:07,723 adding 'deepspeed/runtime/data_pipeline/curriculum_scheduler.py' 2023-11-23T10:47:07,725 adding 'deepspeed/runtime/data_pipeline/data_routing/__init__.py' 2023-11-23T10:47:07,726 adding 'deepspeed/runtime/data_pipeline/data_routing/basic_layer.py' 2023-11-23T10:47:07,728 adding 'deepspeed/runtime/data_pipeline/data_routing/helper.py' 2023-11-23T10:47:07,729 adding 'deepspeed/runtime/data_pipeline/data_routing/scheduler.py' 2023-11-23T10:47:07,730 adding 'deepspeed/runtime/data_pipeline/data_routing/utils.py' 2023-11-23T10:47:07,732 adding 'deepspeed/runtime/data_pipeline/data_sampling/__init__.py' 2023-11-23T10:47:07,735 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_analyzer.py' 2023-11-23T10:47:07,737 adding 'deepspeed/runtime/data_pipeline/data_sampling/data_sampler.py' 2023-11-23T10:47:07,740 adding 'deepspeed/runtime/data_pipeline/data_sampling/indexed_dataset.py' 2023-11-23T10:47:07,741 adding 'deepspeed/runtime/data_pipeline/data_sampling/utils.py' 2023-11-23T10:47:07,743 adding 'deepspeed/runtime/fp16/__init__.py' 2023-11-23T10:47:07,746 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2023-11-23T10:47:07,748 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2023-11-23T10:47:07,750 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2023-11-23T10:47:07,752 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2023-11-23T10:47:07,755 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2023-11-23T10:47:07,757 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2023-11-23T10:47:07,760 adding 'deepspeed/runtime/fp16/onebit/zoadam.py' 2023-11-23T10:47:07,762 adding 'deepspeed/runtime/pipe/__init__.py' 2023-11-23T10:47:07,768 adding 'deepspeed/runtime/pipe/engine.py' 2023-11-23T10:47:07,772 adding 'deepspeed/runtime/pipe/module.py' 2023-11-23T10:47:07,773 adding 'deepspeed/runtime/pipe/p2p.py' 2023-11-23T10:47:07,775 adding 'deepspeed/runtime/pipe/schedule.py' 2023-11-23T10:47:07,778 adding 'deepspeed/runtime/pipe/topology.py' 2023-11-23T10:47:07,780 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2023-11-23T10:47:07,781 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2023-11-23T10:47:07,782 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2023-11-23T10:47:07,783 adding 'deepspeed/runtime/swap_tensor/constants.py' 2023-11-23T10:47:07,786 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2023-11-23T10:47:07,788 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2023-11-23T10:47:07,790 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2023-11-23T10:47:07,792 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2023-11-23T10:47:07,794 adding 'deepspeed/runtime/swap_tensor/utils.py' 2023-11-23T10:47:07,795 adding 'deepspeed/runtime/zero/__init__.py' 2023-11-23T10:47:07,797 adding 'deepspeed/runtime/zero/config.py' 2023-11-23T10:47:07,799 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2023-11-23T10:47:07,801 adding 'deepspeed/runtime/zero/linear.py' 2023-11-23T10:47:07,804 adding 'deepspeed/runtime/zero/mics.py' 2023-11-23T10:47:07,806 adding 'deepspeed/runtime/zero/mics_utils.py' 2023-11-23T10:47:07,807 adding 'deepspeed/runtime/zero/offload_config.py' 2023-11-23T10:47:07,810 adding 'deepspeed/runtime/zero/parameter_offload.py' 2023-11-23T10:47:07,821 adding 'deepspeed/runtime/zero/partition_parameters.py' 2023-11-23T10:47:07,825 adding 'deepspeed/runtime/zero/partitioned_param_coordinator.py' 2023-11-23T10:47:07,827 adding 'deepspeed/runtime/zero/partitioned_param_profiler.py' 2023-11-23T10:47:07,840 adding 'deepspeed/runtime/zero/stage3.py' 2023-11-23T10:47:07,854 adding 'deepspeed/runtime/zero/stage_1_and_2.py' 2023-11-23T10:47:07,856 adding 'deepspeed/runtime/zero/test.py' 2023-11-23T10:47:07,858 adding 'deepspeed/runtime/zero/tiling.py' 2023-11-23T10:47:07,860 adding 'deepspeed/runtime/zero/utils.py' 2023-11-23T10:47:07,861 adding 'deepspeed/sequence/__init__.py' 2023-11-23T10:47:07,863 adding 'deepspeed/sequence/layer.py' 2023-11-23T10:47:07,865 adding 'deepspeed/utils/__init__.py' 2023-11-23T10:47:07,866 adding 'deepspeed/utils/comms_logging.py' 2023-11-23T10:47:07,868 adding 'deepspeed/utils/debug.py' 2023-11-23T10:47:07,869 adding 'deepspeed/utils/exceptions.py' 2023-11-23T10:47:07,871 adding 'deepspeed/utils/groups.py' 2023-11-23T10:47:07,873 adding 'deepspeed/utils/init_on_device.py' 2023-11-23T10:47:07,874 adding 'deepspeed/utils/logging.py' 2023-11-23T10:47:07,876 adding 'deepspeed/utils/mixed_precision_linkage.py' 2023-11-23T10:47:07,877 adding 'deepspeed/utils/numa.py' 2023-11-23T10:47:07,879 adding 'deepspeed/utils/nvtx.py' 2023-11-23T10:47:07,881 adding 'deepspeed/utils/tensor_fragment.py' 2023-11-23T10:47:07,883 adding 'deepspeed/utils/timer.py' 2023-11-23T10:47:07,884 adding 'deepspeed/utils/types.py' 2023-11-23T10:47:07,887 adding 'deepspeed/utils/zero_to_fp32.py' 2023-11-23T10:47:07,889 adding 'deepspeed-0.12.3.data/scripts/deepspeed' 2023-11-23T10:47:07,891 adding 'deepspeed-0.12.3.data/scripts/deepspeed.pt' 2023-11-23T10:47:07,892 adding 'deepspeed-0.12.3.data/scripts/ds' 2023-11-23T10:47:07,893 adding 'deepspeed-0.12.3.data/scripts/ds_bench' 2023-11-23T10:47:07,894 adding 'deepspeed-0.12.3.data/scripts/ds_elastic' 2023-11-23T10:47:07,895 adding 'deepspeed-0.12.3.data/scripts/ds_report' 2023-11-23T10:47:07,896 adding 'deepspeed-0.12.3.data/scripts/ds_ssh' 2023-11-23T10:47:07,897 adding 'deepspeed-0.12.3.data/scripts/dsr' 2023-11-23T10:47:07,903 adding 'deepspeed-0.12.3.dist-info/METADATA' 2023-11-23T10:47:07,904 adding 'deepspeed-0.12.3.dist-info/WHEEL' 2023-11-23T10:47:07,905 adding 'deepspeed-0.12.3.dist-info/entry_points.txt' 2023-11-23T10:47:07,906 adding 'deepspeed-0.12.3.dist-info/top_level.txt' 2023-11-23T10:47:07,918 adding 'deepspeed-0.12.3.dist-info/RECORD' 2023-11-23T10:47:07,941 removing build/bdist.linux-armv7l/wheel 2023-11-23T10:47:08,131 deepspeed build time = 8.781183958053589 secs 2023-11-23T10:47:08,252 Building wheel for deepspeed (setup.py): finished with status 'done' 2023-11-23T10:47:08,270 Created wheel for deepspeed: filename=deepspeed-0.12.3-py3-none-any.whl size=1279121 sha256=c16896f7841bed13772dcf84d8e1dbe161d94495e4eb95d6ac7f7d2f2f82319f 2023-11-23T10:47:08,271 Stored in directory: /tmp/pip-ephem-wheel-cache-fi6jm4wo/wheels/5d/a2/ba/e2880049c04875afc5d33ce35cbee5e2ffbcebadc57161cba0 2023-11-23T10:47:08,308 Successfully built deepspeed 2023-11-23T10:47:08,337 Removed build tracker: '/tmp/pip-build-tracker-hqla73jn'