2021-07-01T17:18:14,013 Created temporary directory: /tmp/pip-ephem-wheel-cache-1zopdr_2 2021-07-01T17:18:14,016 Created temporary directory: /tmp/pip-req-tracker-t92njsn8 2021-07-01T17:18:14,017 Initialized build tracking at /tmp/pip-req-tracker-t92njsn8 2021-07-01T17:18:14,017 Created build tracker: /tmp/pip-req-tracker-t92njsn8 2021-07-01T17:18:14,017 Entered build tracker: /tmp/pip-req-tracker-t92njsn8 2021-07-01T17:18:14,018 Created temporary directory: /tmp/pip-wheel-8tf2oh0x 2021-07-01T17:18:14,055 1 location(s) to search for versions of deepspeed: 2021-07-01T17:18:14,055 * https://pypi.org/simple/deepspeed/ 2021-07-01T17:18:14,055 Fetching project page and analyzing links: https://pypi.org/simple/deepspeed/ 2021-07-01T17:18:14,056 Getting page https://pypi.org/simple/deepspeed/ 2021-07-01T17:18:14,058 Found index url https://pypi.org/simple 2021-07-01T17:18:14,173 Found link https://files.pythonhosted.org/packages/d6/a8/24c77dac84850ca0b18eba52a389641466460715b704ced8d466cc592550/deepspeed-0.3.1.dev1-py3-none-any.whl#sha256=90c0d0bd6e80a77fbf44d1efb6c4e37bf8c17487666693b3c63a6ab050dd865e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-07-01T17:18:14,174 Found link https://files.pythonhosted.org/packages/ab/b9/0e60303ade461dae1eb626ff5469a16b2f44f72d8379c0a0da04f28e9040/deepspeed-0.3.1.dev1.tar.gz#sha256=f1221cf9c912b3b49a67f1d53ce4df3545e7443c487d459e352fd346f053cde5 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev1 2021-07-01T17:18:14,175 Found link https://files.pythonhosted.org/packages/14/7e/a5a88706d712eb2765fa7809848531c766a7128e9939ac850fbb3e00b7b5/deepspeed-0.3.1.dev2-py3-none-any.whl#sha256=2b3354e1c31eac893a9676853a007005d9caa7af0d461741088f0cadb4ec9d43 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-07-01T17:18:14,176 Found link https://files.pythonhosted.org/packages/8f/2b/53cddc1f483bbade5a2432739df7d9486b6b84d6685cfc1c5e4be68ad8e8/deepspeed-0.3.1.dev2.tar.gz#sha256=2e1b30e626473d2a01fa4dd32a0fc99828625e4533a379429cbf97064082b100 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev2 2021-07-01T17:18:14,177 Found link https://files.pythonhosted.org/packages/a0/24/73323e0f5cb78ab16525b3c3f690983d60ced9e8bad7310fe7db70379137/deepspeed-0.3.1.dev3-py3-none-any.whl#sha256=70716851a730abf07c1d9cf0cb82bba1fbbc7a69362f31eae12cd9327ad157a6 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-07-01T17:18:14,178 Found link https://files.pythonhosted.org/packages/66/76/a3bbc891d1341f69ebad3b7867918430262ea1fb0dcec36c3d7482f6c3d6/deepspeed-0.3.1.dev3.tar.gz#sha256=3d011c254eecc8deefafcfdfba1c39c13395e688dffa70aa7a890fe5357efd39 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev3 2021-07-01T17:18:14,180 Found link https://files.pythonhosted.org/packages/48/f7/3a75ab9b3f47efe5009c17896c4baadf1d644a3654e7f87cf7edaf01bb02/deepspeed-0.3.1.dev4-py3-none-any.whl#sha256=18dff0ab7bdfc9d12ebb01efa50a959269e758c374a0ba9a95259415e3b9b975 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-07-01T17:18:14,181 Found link https://files.pythonhosted.org/packages/69/31/e30a51a699d14394f67d930f42242f61bd9889e44a73ce3135c4bce01035/deepspeed-0.3.1.dev4.tar.gz#sha256=6a4f81816ab75e5e21e129f8d28b83f70ed392ce730b79312b0384bfc40d94fd (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev4 2021-07-01T17:18:14,182 Found link https://files.pythonhosted.org/packages/34/25/3888cb8891a857c9000c4f2944da2a7e324feb578fa7be53bfe97f2c63a3/deepspeed-0.3.1.dev5-py3-none-any.whl#sha256=8077d5af79f3e1e4d1cef0a789d17390ead1ce2d21e875894455529a26af158a (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-07-01T17:18:14,182 Found link https://files.pythonhosted.org/packages/ce/1e/f7afd7538d693afd15f9a3b961991fc1c9d2048eb555a599e052628c0615/deepspeed-0.3.1.dev5.tar.gz#sha256=1ae6f0ab662b36e906a06a1ce67eed544c69c3faf2428255c152003c23fdfc29 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev5 2021-07-01T17:18:14,183 Found link https://files.pythonhosted.org/packages/03/17/b21a0d25154fbc3ad2955f315eb4cc785c1520764c8cb50523ab1a6e4dc2/deepspeed-0.3.1.dev6.tar.gz#sha256=f6d6b750156a4cd502c3ae32aefe4d64338efff0cac4d0c84dbf6ca3965d386e (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev6 2021-07-01T17:18:14,185 Found link https://files.pythonhosted.org/packages/fb/b8/4e29d662fa1de1e82a6938b238f83c2f4dc656c323411acdbdd7e1f31ca6/deepspeed-0.3.1.dev7.tar.gz#sha256=4e0539e5fab48fc489f27ca222e444d609446251c6170ad58103e875b8ed21c7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev7 2021-07-01T17:18:14,186 Found link https://files.pythonhosted.org/packages/06/71/d3550f8f35a960176d869ed41a0ff1809e24e9a8f7d3b9a834b1ab4b1ada/deepspeed-0.3.1.dev8.tar.gz#sha256=2f9ae8b55c4391b9b953d0224c78bbd6d9c6dce0968a691d069163ecfeff89f7 (from https://pypi.org/simple/deepspeed/), version: 0.3.1.dev8 2021-07-01T17:18:14,188 Found link https://files.pythonhosted.org/packages/55/07/6202a9dd8ac64d24849932cc486ae5e42258415157ddb14d12a1413980d3/deepspeed-0.3.1.tar.gz#sha256=8e644be6b561b524f8103d873afe05acbd20d526797793936728109a32ebe199 (from https://pypi.org/simple/deepspeed/), version: 0.3.1 2021-07-01T17:18:14,189 Found link https://files.pythonhosted.org/packages/ac/d9/2d64df87f9588844548ce2aa52365bcab620609e0106a966f4d81d69833d/deepspeed-0.3.2.tar.gz#sha256=67e73e62ec120ae458db4db7970dec737b1b3b6345a367fd9fba8f283cdcacb0 (from https://pypi.org/simple/deepspeed/), version: 0.3.2 2021-07-01T17:18:14,189 Found link https://files.pythonhosted.org/packages/fd/03/75aebaff57261182fe4a2254cffc14d6c9fef1c47c34229bbfb994525165/deepspeed-0.3.3.tar.gz#sha256=ba7a43296cf520a99e1ad2ae5b278d429844f42aa237838897baa8c31a18aef0 (from https://pypi.org/simple/deepspeed/), version: 0.3.3 2021-07-01T17:18:14,190 Found link https://files.pythonhosted.org/packages/eb/fc/6ad199be8eabca7ef61404d45b215f10d90cabace59e820a89cd89032229/deepspeed-0.3.4.tar.gz#sha256=a43bbbfee9677b505c4dcd302347aa81a52d332a9ea7f7ecce06f37590860289 (from https://pypi.org/simple/deepspeed/), version: 0.3.4 2021-07-01T17:18:14,191 Found link https://files.pythonhosted.org/packages/4a/f5/7e31934c0a924658aacd3ea0e1d9c6c15b8f5fd5625c0ba8a9d50a557443/deepspeed-0.3.5.tar.gz#sha256=eefa6147c24933a28faf5a62bac67273a85fc77a9607e3fbebff47e8e50b9304 (from https://pypi.org/simple/deepspeed/), version: 0.3.5 2021-07-01T17:18:14,191 Found link https://files.pythonhosted.org/packages/48/07/a1c949a39c9aacc47e66a1ef3e90b818a4b92e3a2c5f48c518fa5a90f320/deepspeed-0.3.6.tar.gz#sha256=0c84e0846776f3ee9d2c61ffd13784ab911672054438fb5b6295551e69130e6f (from https://pypi.org/simple/deepspeed/), version: 0.3.6 2021-07-01T17:18:14,192 Found link https://files.pythonhosted.org/packages/1f/f6/4de24b5790621e9eb787b7e4d90a57075ebbb85e81100a0dc8c50fdba8ba/deepspeed-0.3.7.tar.gz#sha256=920a26b28156eeb371cc2a5af0323d7581bb4956fd4ab1b17f955c0d560658ca (from https://pypi.org/simple/deepspeed/), version: 0.3.7 2021-07-01T17:18:14,193 Found link https://files.pythonhosted.org/packages/d5/f7/e45734d0074336e16f704372c85be7fa867abaa6f5667ffadbadb6ab4fa0/deepspeed-0.3.8.tar.gz#sha256=fdc028c7f96a76a65085c17a0ca27372bab1fe473055e3ca6ec07ae47f77a30a (from https://pypi.org/simple/deepspeed/), version: 0.3.8 2021-07-01T17:18:14,194 Found link https://files.pythonhosted.org/packages/a1/e7/1a7af3bff34380dc3806ae4e3d803d69ab842e71fb1c323a68f6c339b903/deepspeed-0.3.9.tar.gz#sha256=a6a87549bc3cc9c8342a24476808d857ac1e5592369ff9809da7432c42ef1865 (from https://pypi.org/simple/deepspeed/), version: 0.3.9 2021-07-01T17:18:14,194 Found link https://files.pythonhosted.org/packages/3f/bd/b2b544ca1286252e9a559b1508e64d0d61af7a73b6bf6737568858128e11/deepspeed-0.3.10.tar.gz#sha256=45e96deaf8b61f1bb890851adbcfb3faef4bc87c838713030725889207ce41c3 (from https://pypi.org/simple/deepspeed/), version: 0.3.10 2021-07-01T17:18:14,195 Found link https://files.pythonhosted.org/packages/47/c6/125248152b93cb1d73c714ee48cbcb1e4bd6a118cd383bbfbbf8399773e9/deepspeed-0.3.11.tar.gz#sha256=b6753b41870a212c3f973da6690fd70b792d49e5adc221c31eba67809d960d6e (from https://pypi.org/simple/deepspeed/), version: 0.3.11 2021-07-01T17:18:14,196 Found link https://files.pythonhosted.org/packages/fb/17/3e31b423862954f897eec547725e8e6f5148dfa26670fe285011d8c0c68b/deepspeed-0.3.12.tar.gz#sha256=14e39428d7c804057e962e9c4e62f26ae00b17b5a2d7e0249132a6cc966d6c79 (from https://pypi.org/simple/deepspeed/), version: 0.3.12 2021-07-01T17:18:14,197 Found link https://files.pythonhosted.org/packages/9a/fe/e49e41a5650952e693abdaef80ec97addec2c061632f978c213d2adb3b7c/deepspeed-0.3.13.tar.gz#sha256=c3ec76c0290da4554f2917327037dfc33123e82a91dac0abc1aae94de5166950 (from https://pypi.org/simple/deepspeed/), version: 0.3.13 2021-07-01T17:18:14,198 Found link https://files.pythonhosted.org/packages/0e/80/29ab47a6f278116ed10f5e0c28c9c3a163d6c8fe6902c221ef4650c7a144/deepspeed-0.3.14.tar.gz#sha256=26d09c75bc66425d1707266ae377485fb2da284e46a74e01e86b24028f479326 (from https://pypi.org/simple/deepspeed/), version: 0.3.14 2021-07-01T17:18:14,198 Found link https://files.pythonhosted.org/packages/23/f8/9f38a1aaaca697b8b359473eb299972386ab6cf880d8ca89a9a142f46cce/deepspeed-0.3.15.tar.gz#sha256=6761d8e4d3a508c89e3c9b37b6bb9b838dfc3d7c16059d455b0baffa2ac8a247 (from https://pypi.org/simple/deepspeed/), version: 0.3.15 2021-07-01T17:18:14,199 Found link https://files.pythonhosted.org/packages/1e/b2/df8d2c39a8d0b125be9438a400b24d77fa0901973d6d9b3bf4e3a8ea328d/deepspeed-0.3.16.tar.gz#sha256=3fe047a0991daac8413ffe694534da2178665467c4f0b428ffffa9e5ba7e888f (from https://pypi.org/simple/deepspeed/), version: 0.3.16 2021-07-01T17:18:14,200 Found link https://files.pythonhosted.org/packages/7e/67/eb2cc076dbd313a8716b4e9b8206cf04228117c95dcb19dc991514735fd5/deepspeed-0.4.0.tar.gz#sha256=a9b2f4d65bb0e81feecf280ba692de7f918fac4ee684ac1a8a232bb32824378a (from https://pypi.org/simple/deepspeed/), version: 0.4.0 2021-07-01T17:18:14,201 Found link https://files.pythonhosted.org/packages/70/c8/9068af14c8d7792e0ca6aabae89c16ed2164c1dc2028f80e8cc201415158/deepspeed-0.4.1.tar.gz#sha256=4f402120d061160f7bfb4700b0d66f347df64e12e5144bad1f2628727a0bd9a1 (from https://pypi.org/simple/deepspeed/), version: 0.4.1 2021-07-01T17:18:14,202 Found link https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 (from https://pypi.org/simple/deepspeed/), version: 0.4.2 2021-07-01T17:18:14,202 Skipping link: not a file: https://pypi.org/simple/deepspeed/ 2021-07-01T17:18:14,208 Given no hashes to check 1 links for project 'deepspeed': discarding no candidates 2021-07-01T17:18:14,227 Collecting deepspeed==0.4.2 2021-07-01T17:18:14,230 Created temporary directory: /tmp/pip-unpack-glke_u36 2021-07-01T17:18:14,274 Downloading deepspeed-0.4.2.tar.gz (448 kB) 2021-07-01T17:18:15,138 Added deepspeed==0.4.2 from https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 to build tracker '/tmp/pip-req-tracker-t92njsn8' 2021-07-01T17:18:15,139 Running setup.py (path:/tmp/pip-wheel-8tf2oh0x/deepspeed_7e906a2d11d64cada84a78f0b2c9cdcc/setup.py) egg_info for package deepspeed 2021-07-01T17:18:15,140 Created temporary directory: /tmp/pip-pip-egg-info-0la8xovw 2021-07-01T17:18:15,140 Running command python setup.py egg_info 2021-07-01T17:18:16,338 fatal: not a git repository (or any of the parent directories): .git 2021-07-01T17:18:16,632 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-07-01T17:18:16,632 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-07-01T17:18:16,632 DS_BUILD_OPS=0 2021-07-01T17:18:16,633 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-07-01T17:18:16,633 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-07-01T17:18:16,633 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-07-01T17:18:16,633 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-07-01T17:18:16,633 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-07-01T17:18:16,633 version=0.4.2, git_hash=unknown, git_branch=unknown 2021-07-01T17:18:16,633 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-07-01T17:18:16,634 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-07-01T17:18:16,634 ext_modules=[] 2021-07-01T17:18:16,634 running egg_info 2021-07-01T17:18:16,634 creating /tmp/pip-pip-egg-info-0la8xovw/deepspeed.egg-info 2021-07-01T17:18:16,635 writing /tmp/pip-pip-egg-info-0la8xovw/deepspeed.egg-info/PKG-INFO 2021-07-01T17:18:16,639 writing dependency_links to /tmp/pip-pip-egg-info-0la8xovw/deepspeed.egg-info/dependency_links.txt 2021-07-01T17:18:16,640 writing entry points to /tmp/pip-pip-egg-info-0la8xovw/deepspeed.egg-info/entry_points.txt 2021-07-01T17:18:16,642 writing requirements to /tmp/pip-pip-egg-info-0la8xovw/deepspeed.egg-info/requires.txt 2021-07-01T17:18:16,643 writing top-level names to /tmp/pip-pip-egg-info-0la8xovw/deepspeed.egg-info/top_level.txt 2021-07-01T17:18:16,644 writing manifest file '/tmp/pip-pip-egg-info-0la8xovw/deepspeed.egg-info/SOURCES.txt' 2021-07-01T17:18:16,813 adding license file 'LICENSE' (matched pattern 'LICEN[CS]E*') 2021-07-01T17:18:16,816 reading manifest file '/tmp/pip-pip-egg-info-0la8xovw/deepspeed.egg-info/SOURCES.txt' 2021-07-01T17:18:16,818 reading manifest template 'MANIFEST.in' 2021-07-01T17:18:17,447 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-07-01T17:18:17,589 warning: no files found matching '*.tr' under directory 'csrc' 2021-07-01T17:18:17,653 warning: no files found matching '*.cc' under directory 'csrc' 2021-07-01T17:18:17,670 writing manifest file '/tmp/pip-pip-egg-info-0la8xovw/deepspeed.egg-info/SOURCES.txt' 2021-07-01T17:18:17,672 deepspeed build time = 1.3278687000274658 secs 2021-07-01T17:18:17,738 Source in /tmp/pip-wheel-8tf2oh0x/deepspeed_7e906a2d11d64cada84a78f0b2c9cdcc has version 0.4.2, which satisfies requirement deepspeed==0.4.2 from https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 2021-07-01T17:18:17,739 Removed deepspeed==0.4.2 from https://files.pythonhosted.org/packages/10/24/d43cf5f0ec0194671c3d6032bcb7ba381d2ce308d408f14378e3e5276390/deepspeed-0.4.2.tar.gz#sha256=6cd75cff921c0af9ef8521243b6ca7bd0e102880016379fdca0039c572fad638 from build tracker '/tmp/pip-req-tracker-t92njsn8' 2021-07-01T17:18:17,745 Created temporary directory: /tmp/pip-unpack-oeati7l5 2021-07-01T17:18:17,746 Building wheels for collected packages: deepspeed 2021-07-01T17:18:17,750 Created temporary directory: /tmp/pip-wheel-jedfy5ke 2021-07-01T17:18:17,750 Building wheel for deepspeed (setup.py): started 2021-07-01T17:18:17,751 Destination directory: /tmp/pip-wheel-jedfy5ke 2021-07-01T17:18:17,751 Running command /usr/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-wheel-8tf2oh0x/deepspeed_7e906a2d11d64cada84a78f0b2c9cdcc/setup.py'"'"'; __file__='"'"'/tmp/pip-wheel-8tf2oh0x/deepspeed_7e906a2d11d64cada84a78f0b2c9cdcc/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-jedfy5ke 2021-07-01T17:18:18,626 [WARNING] Unable to import torch, pre-compiling ops will be disabled. Please visit https://pytorch.org/ to see how to properly install torch on your system. 2021-07-01T17:18:18,633 �[93m [WARNING] �[0m unable to import torch, please install it if you want to pre-compile any deepspeed ops. 2021-07-01T17:18:18,643 DS_BUILD_OPS=0 2021-07-01T17:18:18,644 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-07-01T17:18:18,726 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-07-01T17:18:18,727 �[93m [WARNING] �[0m unable to import torch, please install it first 2021-07-01T17:18:18,809 �[93m [WARNING] �[0m async_io requires the libraries: ['libaio-dev'] but are missing. Can be fixed by: `apt install libaio-dev`. 2021-07-01T17:18:18,809 Install Ops={'cpu_adam': False, 'fused_adam': False, 'fused_lamb': False, 'sparse_attn': False, 'transformer': False, 'stochastic_transformer': False, 'async_io': False, 'transformer_inference': False, 'utils': False, 'quantizer': False} 2021-07-01T17:18:18,828 fatal: not a git repository (or any of the parent directories): .git 2021-07-01T17:18:18,831 version=0.4.2, git_hash=unknown, git_branch=unknown 2021-07-01T17:18:18,832 install_requires=['torch>=1.2', 'tqdm', 'tensorboardX==1.8', 'ninja', 'numpy', 'psutil', 'packaging'] 2021-07-01T17:18:18,833 compatible_ops={'cpu_adam': True, 'fused_adam': True, 'fused_lamb': True, 'sparse_attn': False, 'transformer': True, 'stochastic_transformer': True, 'async_io': False, 'transformer_inference': True, 'utils': True, 'quantizer': True} 2021-07-01T17:18:18,833 ext_modules=[] 2021-07-01T17:18:19,127 running bdist_wheel 2021-07-01T17:18:19,132 running build 2021-07-01T17:18:19,133 running build_py 2021-07-01T17:18:19,270 creating build 2021-07-01T17:18:19,271 creating build/lib 2021-07-01T17:18:19,271 creating build/lib/op_builder 2021-07-01T17:18:19,273 copying op_builder/async_io.py -> build/lib/op_builder 2021-07-01T17:18:19,275 copying op_builder/__init__.py -> build/lib/op_builder 2021-07-01T17:18:19,277 copying op_builder/utils.py -> build/lib/op_builder 2021-07-01T17:18:19,279 copying op_builder/fused_lamb.py -> build/lib/op_builder 2021-07-01T17:18:19,281 copying op_builder/stochastic_transformer.py -> build/lib/op_builder 2021-07-01T17:18:19,283 copying op_builder/fused_adam.py -> build/lib/op_builder 2021-07-01T17:18:19,285 copying op_builder/transformer_inference.py -> build/lib/op_builder 2021-07-01T17:18:19,287 copying op_builder/sparse_attn.py -> build/lib/op_builder 2021-07-01T17:18:19,289 copying op_builder/cpu_adam.py -> build/lib/op_builder 2021-07-01T17:18:19,291 copying op_builder/quantizer.py -> build/lib/op_builder 2021-07-01T17:18:19,293 copying op_builder/transformer.py -> build/lib/op_builder 2021-07-01T17:18:19,296 copying op_builder/builder.py -> build/lib/op_builder 2021-07-01T17:18:19,300 creating build/lib/deepspeed 2021-07-01T17:18:19,301 copying deepspeed/__init__.py -> build/lib/deepspeed 2021-07-01T17:18:19,304 copying deepspeed/git_version_info.py -> build/lib/deepspeed 2021-07-01T17:18:19,306 copying deepspeed/constants.py -> build/lib/deepspeed 2021-07-01T17:18:19,308 copying deepspeed/env_report.py -> build/lib/deepspeed 2021-07-01T17:18:19,311 copying deepspeed/git_version_info_installed.py -> build/lib/deepspeed 2021-07-01T17:18:19,314 creating build/lib/deepspeed/runtime 2021-07-01T17:18:19,315 copying deepspeed/runtime/state_dict_factory.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,319 copying deepspeed/runtime/progressive_layer_drop.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,321 copying deepspeed/runtime/__init__.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,322 copying deepspeed/runtime/utils.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,325 copying deepspeed/runtime/config.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,328 copying deepspeed/runtime/dataloader.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,331 copying deepspeed/runtime/quantize.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,333 copying deepspeed/runtime/weight_quantizer.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,336 copying deepspeed/runtime/csr_tensor.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,337 copying deepspeed/runtime/lr_schedules.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,341 copying deepspeed/runtime/config_utils.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,344 copying deepspeed/runtime/constants.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,346 copying deepspeed/runtime/engine.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,351 copying deepspeed/runtime/eigenvalue.py -> build/lib/deepspeed/runtime 2021-07-01T17:18:19,354 creating build/lib/deepspeed/pipe 2021-07-01T17:18:19,355 copying deepspeed/pipe/__init__.py -> build/lib/deepspeed/pipe 2021-07-01T17:18:19,358 creating build/lib/deepspeed/module_inject 2021-07-01T17:18:19,359 copying deepspeed/module_inject/__init__.py -> build/lib/deepspeed/module_inject 2021-07-01T17:18:19,361 copying deepspeed/module_inject/replace_policy.py -> build/lib/deepspeed/module_inject 2021-07-01T17:18:19,364 copying deepspeed/module_inject/inject.py -> build/lib/deepspeed/module_inject 2021-07-01T17:18:19,366 copying deepspeed/module_inject/replace_module.py -> build/lib/deepspeed/module_inject 2021-07-01T17:18:19,369 copying deepspeed/module_inject/module_quantize.py -> build/lib/deepspeed/module_inject 2021-07-01T17:18:19,372 creating build/lib/deepspeed/launcher 2021-07-01T17:18:19,373 copying deepspeed/launcher/__init__.py -> build/lib/deepspeed/launcher 2021-07-01T17:18:19,375 copying deepspeed/launcher/launch.py -> build/lib/deepspeed/launcher 2021-07-01T17:18:19,377 copying deepspeed/launcher/constants.py -> build/lib/deepspeed/launcher 2021-07-01T17:18:19,379 copying deepspeed/launcher/runner.py -> build/lib/deepspeed/launcher 2021-07-01T17:18:19,382 copying deepspeed/launcher/multinode_runner.py -> build/lib/deepspeed/launcher 2021-07-01T17:18:19,385 creating build/lib/deepspeed/ops 2021-07-01T17:18:19,386 copying deepspeed/ops/__init__.py -> build/lib/deepspeed/ops 2021-07-01T17:18:19,389 creating build/lib/deepspeed/elasticity 2021-07-01T17:18:19,390 copying deepspeed/elasticity/__init__.py -> build/lib/deepspeed/elasticity 2021-07-01T17:18:19,392 copying deepspeed/elasticity/config.py -> build/lib/deepspeed/elasticity 2021-07-01T17:18:19,394 copying deepspeed/elasticity/constants.py -> build/lib/deepspeed/elasticity 2021-07-01T17:18:19,396 copying deepspeed/elasticity/elasticity.py -> build/lib/deepspeed/elasticity 2021-07-01T17:18:19,400 creating build/lib/deepspeed/profiling 2021-07-01T17:18:19,401 copying deepspeed/profiling/__init__.py -> build/lib/deepspeed/profiling 2021-07-01T17:18:19,403 copying deepspeed/profiling/config.py -> build/lib/deepspeed/profiling 2021-07-01T17:18:19,405 copying deepspeed/profiling/constants.py -> build/lib/deepspeed/profiling 2021-07-01T17:18:19,407 creating build/lib/deepspeed/inference 2021-07-01T17:18:19,408 copying deepspeed/inference/__init__.py -> build/lib/deepspeed/inference 2021-07-01T17:18:19,411 copying deepspeed/inference/engine.py -> build/lib/deepspeed/inference 2021-07-01T17:18:19,414 creating build/lib/deepspeed/utils 2021-07-01T17:18:19,415 copying deepspeed/utils/__init__.py -> build/lib/deepspeed/utils 2021-07-01T17:18:19,417 copying deepspeed/utils/timer.py -> build/lib/deepspeed/utils 2021-07-01T17:18:19,420 copying deepspeed/utils/zero_to_fp32.py -> build/lib/deepspeed/utils 2021-07-01T17:18:19,422 copying deepspeed/utils/logging.py -> build/lib/deepspeed/utils 2021-07-01T17:18:19,424 copying deepspeed/utils/debug.py -> build/lib/deepspeed/utils 2021-07-01T17:18:19,426 copying deepspeed/utils/distributed.py -> build/lib/deepspeed/utils 2021-07-01T17:18:19,430 creating build/lib/deepspeed/runtime/pipe 2021-07-01T17:18:19,431 copying deepspeed/runtime/pipe/__init__.py -> build/lib/deepspeed/runtime/pipe 2021-07-01T17:18:19,433 copying deepspeed/runtime/pipe/topology.py -> build/lib/deepspeed/runtime/pipe 2021-07-01T17:18:19,436 copying deepspeed/runtime/pipe/p2p.py -> build/lib/deepspeed/runtime/pipe 2021-07-01T17:18:19,438 copying deepspeed/runtime/pipe/module.py -> build/lib/deepspeed/runtime/pipe 2021-07-01T17:18:19,441 copying deepspeed/runtime/pipe/schedule.py -> build/lib/deepspeed/runtime/pipe 2021-07-01T17:18:19,444 copying deepspeed/runtime/pipe/engine.py -> build/lib/deepspeed/runtime/pipe 2021-07-01T17:18:19,448 creating build/lib/deepspeed/runtime/compression 2021-07-01T17:18:19,450 copying deepspeed/runtime/compression/cupy.py -> build/lib/deepspeed/runtime/compression 2021-07-01T17:18:19,452 copying deepspeed/runtime/compression/__init__.py -> build/lib/deepspeed/runtime/compression 2021-07-01T17:18:19,455 creating build/lib/deepspeed/runtime/activation_checkpointing 2021-07-01T17:18:19,456 copying deepspeed/runtime/activation_checkpointing/__init__.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-07-01T17:18:19,458 copying deepspeed/runtime/activation_checkpointing/config.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-07-01T17:18:19,461 copying deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/lib/deepspeed/runtime/activation_checkpointing 2021-07-01T17:18:19,465 creating build/lib/deepspeed/runtime/comm 2021-07-01T17:18:19,466 copying deepspeed/runtime/comm/__init__.py -> build/lib/deepspeed/runtime/comm 2021-07-01T17:18:19,468 copying deepspeed/runtime/comm/mpi.py -> build/lib/deepspeed/runtime/comm 2021-07-01T17:18:19,471 copying deepspeed/runtime/comm/nccl.py -> build/lib/deepspeed/runtime/comm 2021-07-01T17:18:19,475 creating build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,476 copying deepspeed/runtime/zero/offload_constants.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,478 copying deepspeed/runtime/zero/stage1.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,482 copying deepspeed/runtime/zero/__init__.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,484 copying deepspeed/runtime/zero/utils.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,486 copying deepspeed/runtime/zero/config.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,488 copying deepspeed/runtime/zero/partition_parameters.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,492 copying deepspeed/runtime/zero/stage2.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,497 copying deepspeed/runtime/zero/offload_config.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,499 copying deepspeed/runtime/zero/tiling.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,501 copying deepspeed/runtime/zero/constants.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,504 copying deepspeed/runtime/zero/linear.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,506 copying deepspeed/runtime/zero/stage3.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,519 copying deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,522 copying deepspeed/runtime/zero/test.py -> build/lib/deepspeed/runtime/zero 2021-07-01T17:18:19,525 creating build/lib/deepspeed/runtime/fp16 2021-07-01T17:18:19,526 copying deepspeed/runtime/fp16/__init__.py -> build/lib/deepspeed/runtime/fp16 2021-07-01T17:18:19,528 copying deepspeed/runtime/fp16/fused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-07-01T17:18:19,531 copying deepspeed/runtime/fp16/loss_scaler.py -> build/lib/deepspeed/runtime/fp16 2021-07-01T17:18:19,534 copying deepspeed/runtime/fp16/unfused_optimizer.py -> build/lib/deepspeed/runtime/fp16 2021-07-01T17:18:19,539 creating build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,540 copying deepspeed/runtime/swap_tensor/__init__.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,543 copying deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,545 copying deepspeed/runtime/swap_tensor/utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,547 copying deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,550 copying deepspeed/runtime/swap_tensor/async_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,552 copying deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,555 copying deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,558 copying deepspeed/runtime/swap_tensor/constants.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,559 copying deepspeed/runtime/swap_tensor/aio_config.py -> build/lib/deepspeed/runtime/swap_tensor 2021-07-01T17:18:19,562 creating build/lib/deepspeed/runtime/fp16/onebit 2021-07-01T17:18:19,563 copying deepspeed/runtime/fp16/onebit/__init__.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-07-01T17:18:19,565 copying deepspeed/runtime/fp16/onebit/adam.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-07-01T17:18:19,568 copying deepspeed/runtime/fp16/onebit/lamb.py -> build/lib/deepspeed/runtime/fp16/onebit 2021-07-01T17:18:19,572 creating build/lib/deepspeed/ops/sparse_attention 2021-07-01T17:18:19,573 copying deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-01T17:18:19,576 copying deepspeed/ops/sparse_attention/__init__.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-01T17:18:19,578 copying deepspeed/ops/sparse_attention/sparsity_config.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-01T17:18:19,583 copying deepspeed/ops/sparse_attention/softmax.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-01T17:18:19,585 copying deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-01T17:18:19,588 copying deepspeed/ops/sparse_attention/matmul.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-01T17:18:19,591 copying deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/lib/deepspeed/ops/sparse_attention 2021-07-01T17:18:19,594 creating build/lib/deepspeed/ops/lamb 2021-07-01T17:18:19,595 copying deepspeed/ops/lamb/__init__.py -> build/lib/deepspeed/ops/lamb 2021-07-01T17:18:19,597 copying deepspeed/ops/lamb/fused_lamb.py -> build/lib/deepspeed/ops/lamb 2021-07-01T17:18:19,600 creating build/lib/deepspeed/ops/adam 2021-07-01T17:18:19,601 copying deepspeed/ops/adam/multi_tensor_apply.py -> build/lib/deepspeed/ops/adam 2021-07-01T17:18:19,603 copying deepspeed/ops/adam/__init__.py -> build/lib/deepspeed/ops/adam 2021-07-01T17:18:19,604 copying deepspeed/ops/adam/fused_adam.py -> build/lib/deepspeed/ops/adam 2021-07-01T17:18:19,607 copying deepspeed/ops/adam/cpu_adam.py -> build/lib/deepspeed/ops/adam 2021-07-01T17:18:19,610 creating build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,611 copying deepspeed/ops/op_builder/async_io.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,613 copying deepspeed/ops/op_builder/__init__.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,615 copying deepspeed/ops/op_builder/utils.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,616 copying deepspeed/ops/op_builder/fused_lamb.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,618 copying deepspeed/ops/op_builder/stochastic_transformer.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,620 copying deepspeed/ops/op_builder/fused_adam.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,622 copying deepspeed/ops/op_builder/transformer_inference.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,624 copying deepspeed/ops/op_builder/sparse_attn.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,626 copying deepspeed/ops/op_builder/cpu_adam.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,627 copying deepspeed/ops/op_builder/quantizer.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,629 copying deepspeed/ops/op_builder/transformer.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,631 copying deepspeed/ops/op_builder/builder.py -> build/lib/deepspeed/ops/op_builder 2021-07-01T17:18:19,634 creating build/lib/deepspeed/ops/aio 2021-07-01T17:18:19,635 copying deepspeed/ops/aio/__init__.py -> build/lib/deepspeed/ops/aio 2021-07-01T17:18:19,637 creating build/lib/deepspeed/ops/quantizer 2021-07-01T17:18:19,638 copying deepspeed/ops/quantizer/__init__.py -> build/lib/deepspeed/ops/quantizer 2021-07-01T17:18:19,640 copying deepspeed/ops/quantizer/quantizer.py -> build/lib/deepspeed/ops/quantizer 2021-07-01T17:18:19,642 creating build/lib/deepspeed/ops/transformer 2021-07-01T17:18:19,643 copying deepspeed/ops/transformer/__init__.py -> build/lib/deepspeed/ops/transformer 2021-07-01T17:18:19,645 copying deepspeed/ops/transformer/transformer.py -> build/lib/deepspeed/ops/transformer 2021-07-01T17:18:19,649 creating build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:19,650 copying deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:19,652 creating build/lib/deepspeed/ops/transformer/inference 2021-07-01T17:18:19,653 copying deepspeed/ops/transformer/inference/__init__.py -> build/lib/deepspeed/ops/transformer/inference 2021-07-01T17:18:19,655 copying deepspeed/ops/transformer/inference/transformer_inference.py -> build/lib/deepspeed/ops/transformer/inference 2021-07-01T17:18:19,658 creating build/lib/deepspeed/profiling/flops_profiler 2021-07-01T17:18:19,659 copying deepspeed/profiling/flops_profiler/__init__.py -> build/lib/deepspeed/profiling/flops_profiler 2021-07-01T17:18:19,661 copying deepspeed/profiling/flops_profiler/profiler.py -> build/lib/deepspeed/profiling/flops_profiler 2021-07-01T17:18:19,664 running egg_info 2021-07-01T17:18:19,680 writing deepspeed.egg-info/PKG-INFO 2021-07-01T17:18:19,683 writing dependency_links to deepspeed.egg-info/dependency_links.txt 2021-07-01T17:18:19,685 writing entry points to deepspeed.egg-info/entry_points.txt 2021-07-01T17:18:19,686 writing requirements to deepspeed.egg-info/requires.txt 2021-07-01T17:18:19,687 writing top-level names to deepspeed.egg-info/top_level.txt 2021-07-01T17:18:19,710 adding license file 'LICENSE' (matched pattern 'LICEN[CS]E*') 2021-07-01T17:18:19,713 reading manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-07-01T17:18:19,722 reading manifest template 'MANIFEST.in' 2021-07-01T17:18:20,358 warning: no files found matching '*.cc' under directory 'deepspeed' 2021-07-01T17:18:20,484 warning: no files found matching '*.tr' under directory 'csrc' 2021-07-01T17:18:20,548 warning: no files found matching '*.cc' under directory 'csrc' 2021-07-01T17:18:20,568 writing manifest file 'deepspeed.egg-info/SOURCES.txt' 2021-07-01T17:18:20,583 creating build/lib/deepspeed/ops/csrc 2021-07-01T17:18:20,584 creating build/lib/deepspeed/ops/csrc/adam 2021-07-01T17:18:20,585 copying deepspeed/ops/csrc/adam/compat.h -> build/lib/deepspeed/ops/csrc/adam 2021-07-01T17:18:20,587 copying deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-07-01T17:18:20,591 copying deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/adam 2021-07-01T17:18:20,593 copying deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/lib/deepspeed/ops/csrc/adam 2021-07-01T17:18:20,595 copying deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/lib/deepspeed/ops/csrc/adam 2021-07-01T17:18:20,598 copying deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/lib/deepspeed/ops/csrc/adam 2021-07-01T17:18:20,601 creating build/lib/deepspeed/ops/csrc/aio 2021-07-01T17:18:20,601 creating build/lib/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:20,602 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:20,606 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:20,608 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:20,611 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:20,614 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:20,616 copying deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/lib/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:20,619 creating build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,620 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,623 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,626 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,629 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,632 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,635 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,638 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,641 copying deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,644 copying deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/lib/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:20,647 creating build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,648 copying deepspeed/ops/csrc/includes/StopWatch.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,651 copying deepspeed/ops/csrc/includes/Timer.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,654 copying deepspeed/ops/csrc/includes/context.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,657 copying deepspeed/ops/csrc/includes/cpu_adam.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,660 copying deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,663 copying deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,666 copying deepspeed/ops/csrc/includes/dropout.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,669 copying deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,672 copying deepspeed/ops/csrc/includes/feed_forward.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,675 copying deepspeed/ops/csrc/includes/gelu.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,677 copying deepspeed/ops/csrc/includes/gemm_test.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,680 copying deepspeed/ops/csrc/includes/general_kernels.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,683 copying deepspeed/ops/csrc/includes/normalize_layer.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,686 copying deepspeed/ops/csrc/includes/quantizer.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,688 copying deepspeed/ops/csrc/includes/softmax.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,691 copying deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,694 copying deepspeed/ops/csrc/includes/type_shim.h -> build/lib/deepspeed/ops/csrc/includes 2021-07-01T17:18:20,697 creating build/lib/deepspeed/ops/csrc/lamb 2021-07-01T17:18:20,697 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/lib/deepspeed/ops/csrc/lamb 2021-07-01T17:18:20,700 copying deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/lib/deepspeed/ops/csrc/lamb 2021-07-01T17:18:20,704 creating build/lib/deepspeed/ops/csrc/quantization 2021-07-01T17:18:20,704 copying deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/quantization 2021-07-01T17:18:20,707 copying deepspeed/ops/csrc/quantization/quantizer.cu -> build/lib/deepspeed/ops/csrc/quantization 2021-07-01T17:18:20,711 creating build/lib/deepspeed/ops/csrc/sparse_attention 2021-07-01T17:18:20,712 copying deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/lib/deepspeed/ops/csrc/sparse_attention 2021-07-01T17:18:20,715 creating build/lib/deepspeed/ops/csrc/transformer 2021-07-01T17:18:20,716 copying deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-01T17:18:20,720 copying deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-01T17:18:20,723 copying deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/lib/deepspeed/ops/csrc/transformer 2021-07-01T17:18:20,728 copying deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-01T17:18:20,731 copying deepspeed/ops/csrc/transformer/general_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-01T17:18:20,735 copying deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-01T17:18:20,739 copying deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-01T17:18:20,743 copying deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/lib/deepspeed/ops/csrc/transformer 2021-07-01T17:18:20,747 creating build/lib/deepspeed/ops/csrc/transformer/inference 2021-07-01T17:18:20,747 creating build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:20,749 copying deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:20,752 copying deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:20,755 copying deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:20,759 copying deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:20,762 copying deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/lib/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:20,766 creating build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-07-01T17:18:20,767 copying deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-07-01T17:18:20,769 copying deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-07-01T17:18:20,773 copying deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/lib/deepspeed/ops/csrc/transformer/inference/includes 2021-07-01T17:18:20,775 creating build/lib/deepspeed/ops/csrc/utils 2021-07-01T17:18:20,776 copying deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/lib/deepspeed/ops/csrc/utils 2021-07-01T17:18:20,779 copying deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:20,782 copying deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:20,784 copying deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/lib/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:20,809 running build_scripts 2021-07-01T17:18:20,809 creating build/scripts-3.7 2021-07-01T17:18:20,811 copying and adjusting bin/deepspeed -> build/scripts-3.7 2021-07-01T17:18:20,812 copying and adjusting bin/deepspeed.pt -> build/scripts-3.7 2021-07-01T17:18:20,814 copying and adjusting bin/ds -> build/scripts-3.7 2021-07-01T17:18:20,816 copying bin/ds_ssh -> build/scripts-3.7 2021-07-01T17:18:20,818 copying and adjusting bin/ds_report -> build/scripts-3.7 2021-07-01T17:18:20,820 copying and adjusting bin/ds_elastic -> build/scripts-3.7 2021-07-01T17:18:20,821 changing mode of build/scripts-3.7/deepspeed from 644 to 755 2021-07-01T17:18:20,821 changing mode of build/scripts-3.7/deepspeed.pt from 644 to 755 2021-07-01T17:18:20,821 changing mode of build/scripts-3.7/ds from 644 to 755 2021-07-01T17:18:20,822 changing mode of build/scripts-3.7/ds_report from 644 to 755 2021-07-01T17:18:20,822 changing mode of build/scripts-3.7/ds_elastic from 644 to 755 2021-07-01T17:18:20,825 installing to build/bdist.linux-armv7l/wheel 2021-07-01T17:18:20,826 running install 2021-07-01T17:18:20,827 running install_lib 2021-07-01T17:18:20,831 creating build/bdist.linux-armv7l 2021-07-01T17:18:20,832 creating build/bdist.linux-armv7l/wheel 2021-07-01T17:18:20,834 creating build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,835 copying build/lib/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,837 copying build/lib/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,839 copying build/lib/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,841 copying build/lib/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,844 copying build/lib/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,846 copying build/lib/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,848 copying build/lib/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,850 copying build/lib/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,852 copying build/lib/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,854 copying build/lib/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,856 copying build/lib/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,858 copying build/lib/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/op_builder 2021-07-01T17:18:20,862 creating build/bdist.linux-armv7l/wheel/deepspeed 2021-07-01T17:18:20,864 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,865 copying build/lib/deepspeed/runtime/state_dict_factory.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,869 copying build/lib/deepspeed/runtime/progressive_layer_drop.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,871 copying build/lib/deepspeed/runtime/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,873 copying build/lib/deepspeed/runtime/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,889 copying build/lib/deepspeed/runtime/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,895 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-01T17:18:20,896 copying build/lib/deepspeed/runtime/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-01T17:18:20,899 copying build/lib/deepspeed/runtime/pipe/topology.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-01T17:18:20,903 copying build/lib/deepspeed/runtime/pipe/p2p.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-01T17:18:20,905 copying build/lib/deepspeed/runtime/pipe/module.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-01T17:18:20,909 copying build/lib/deepspeed/runtime/pipe/schedule.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-01T17:18:20,912 copying build/lib/deepspeed/runtime/pipe/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/pipe 2021-07-01T17:18:20,916 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-07-01T17:18:20,917 copying build/lib/deepspeed/runtime/compression/cupy.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-07-01T17:18:20,919 copying build/lib/deepspeed/runtime/compression/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/compression 2021-07-01T17:18:20,921 copying build/lib/deepspeed/runtime/dataloader.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,923 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-07-01T17:18:20,924 copying build/lib/deepspeed/runtime/activation_checkpointing/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-07-01T17:18:20,926 copying build/lib/deepspeed/runtime/activation_checkpointing/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-07-01T17:18:20,929 copying build/lib/deepspeed/runtime/activation_checkpointing/checkpointing.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/activation_checkpointing 2021-07-01T17:18:20,932 copying build/lib/deepspeed/runtime/quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,935 copying build/lib/deepspeed/runtime/weight_quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,938 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-07-01T17:18:20,939 copying build/lib/deepspeed/runtime/comm/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-07-01T17:18:20,941 copying build/lib/deepspeed/runtime/comm/mpi.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-07-01T17:18:20,944 copying build/lib/deepspeed/runtime/comm/nccl.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/comm 2021-07-01T17:18:20,947 copying build/lib/deepspeed/runtime/csr_tensor.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,949 copying build/lib/deepspeed/runtime/lr_schedules.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:20,953 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,954 copying build/lib/deepspeed/runtime/zero/offload_constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,957 copying build/lib/deepspeed/runtime/zero/stage1.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,961 copying build/lib/deepspeed/runtime/zero/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,963 copying build/lib/deepspeed/runtime/zero/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,966 copying build/lib/deepspeed/runtime/zero/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,969 copying build/lib/deepspeed/runtime/zero/partition_parameters.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,973 copying build/lib/deepspeed/runtime/zero/stage2.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,978 copying build/lib/deepspeed/runtime/zero/offload_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,980 copying build/lib/deepspeed/runtime/zero/tiling.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,983 copying build/lib/deepspeed/runtime/zero/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,985 copying build/lib/deepspeed/runtime/zero/linear.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,988 copying build/lib/deepspeed/runtime/zero/stage3.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,996 copying build/lib/deepspeed/runtime/zero/contiguous_memory_allocator.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:20,999 copying build/lib/deepspeed/runtime/zero/test.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/zero 2021-07-01T17:18:21,001 copying build/lib/deepspeed/runtime/config_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:21,003 copying build/lib/deepspeed/runtime/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:21,007 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-01T17:18:21,008 copying build/lib/deepspeed/runtime/fp16/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-01T17:18:21,010 copying build/lib/deepspeed/runtime/fp16/fused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-01T17:18:21,013 copying build/lib/deepspeed/runtime/fp16/loss_scaler.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-01T17:18:21,016 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-07-01T17:18:21,017 copying build/lib/deepspeed/runtime/fp16/onebit/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-07-01T17:18:21,019 copying build/lib/deepspeed/runtime/fp16/onebit/adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-07-01T17:18:21,022 copying build/lib/deepspeed/runtime/fp16/onebit/lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16/onebit 2021-07-01T17:18:21,025 copying build/lib/deepspeed/runtime/fp16/unfused_optimizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/fp16 2021-07-01T17:18:21,029 creating build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,030 copying build/lib/deepspeed/runtime/swap_tensor/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,032 copying build/lib/deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,035 copying build/lib/deepspeed/runtime/swap_tensor/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,038 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,040 copying build/lib/deepspeed/runtime/swap_tensor/async_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,043 copying build/lib/deepspeed/runtime/swap_tensor/partitioned_param_swapper.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,046 copying build/lib/deepspeed/runtime/swap_tensor/optimizer_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,049 copying build/lib/deepspeed/runtime/swap_tensor/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,051 copying build/lib/deepspeed/runtime/swap_tensor/aio_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime/swap_tensor 2021-07-01T17:18:21,053 copying build/lib/deepspeed/runtime/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:21,059 copying build/lib/deepspeed/runtime/eigenvalue.py -> build/bdist.linux-armv7l/wheel/deepspeed/runtime 2021-07-01T17:18:21,061 copying build/lib/deepspeed/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-01T17:18:21,065 creating build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-07-01T17:18:21,066 copying build/lib/deepspeed/pipe/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/pipe 2021-07-01T17:18:21,069 creating build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-01T17:18:21,070 copying build/lib/deepspeed/module_inject/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-01T17:18:21,072 copying build/lib/deepspeed/module_inject/replace_policy.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-01T17:18:21,074 copying build/lib/deepspeed/module_inject/inject.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-01T17:18:21,076 copying build/lib/deepspeed/module_inject/replace_module.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-01T17:18:21,079 copying build/lib/deepspeed/module_inject/module_quantize.py -> build/bdist.linux-armv7l/wheel/deepspeed/module_inject 2021-07-01T17:18:21,082 creating build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-01T17:18:21,082 copying build/lib/deepspeed/launcher/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-01T17:18:21,084 copying build/lib/deepspeed/launcher/launch.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-01T17:18:21,086 copying build/lib/deepspeed/launcher/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-01T17:18:21,088 copying build/lib/deepspeed/launcher/runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-01T17:18:21,091 copying build/lib/deepspeed/launcher/multinode_runner.py -> build/bdist.linux-armv7l/wheel/deepspeed/launcher 2021-07-01T17:18:21,093 copying build/lib/deepspeed/git_version_info.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-01T17:18:21,096 creating build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-07-01T17:18:21,098 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-01T17:18:21,099 copying build/lib/deepspeed/ops/sparse_attention/sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-01T17:18:21,102 copying build/lib/deepspeed/ops/sparse_attention/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-01T17:18:21,103 copying build/lib/deepspeed/ops/sparse_attention/sparsity_config.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-01T17:18:21,107 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:21,108 copying build/lib/deepspeed/ops/sparse_attention/trsrc/matmul.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:21,111 copying build/lib/deepspeed/ops/sparse_attention/trsrc/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:21,113 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:21,115 copying build/lib/deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention/trsrc 2021-07-01T17:18:21,117 copying build/lib/deepspeed/ops/sparse_attention/softmax.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-01T17:18:21,120 copying build/lib/deepspeed/ops/sparse_attention/sparse_attention_utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-01T17:18:21,123 copying build/lib/deepspeed/ops/sparse_attention/matmul.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-01T17:18:21,126 copying build/lib/deepspeed/ops/sparse_attention/bert_sparse_self_attention.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/sparse_attention 2021-07-01T17:18:21,129 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-07-01T17:18:21,130 copying build/lib/deepspeed/ops/lamb/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-07-01T17:18:21,132 copying build/lib/deepspeed/ops/lamb/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/lamb 2021-07-01T17:18:21,135 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-01T17:18:21,136 copying build/lib/deepspeed/ops/adam/multi_tensor_apply.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-01T17:18:21,138 copying build/lib/deepspeed/ops/adam/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-01T17:18:21,140 copying build/lib/deepspeed/ops/adam/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-01T17:18:21,143 copying build/lib/deepspeed/ops/adam/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/adam 2021-07-01T17:18:21,145 copying build/lib/deepspeed/ops/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops 2021-07-01T17:18:21,148 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,149 copying build/lib/deepspeed/ops/op_builder/async_io.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,151 copying build/lib/deepspeed/ops/op_builder/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,153 copying build/lib/deepspeed/ops/op_builder/utils.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,155 copying build/lib/deepspeed/ops/op_builder/fused_lamb.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,157 copying build/lib/deepspeed/ops/op_builder/stochastic_transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,159 copying build/lib/deepspeed/ops/op_builder/fused_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,161 copying build/lib/deepspeed/ops/op_builder/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,163 copying build/lib/deepspeed/ops/op_builder/sparse_attn.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,165 copying build/lib/deepspeed/ops/op_builder/cpu_adam.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,167 copying build/lib/deepspeed/ops/op_builder/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,169 copying build/lib/deepspeed/ops/op_builder/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,171 copying build/lib/deepspeed/ops/op_builder/builder.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/op_builder 2021-07-01T17:18:21,174 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-07-01T17:18:21,175 copying build/lib/deepspeed/ops/aio/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/aio 2021-07-01T17:18:21,178 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-07-01T17:18:21,179 copying build/lib/deepspeed/ops/quantizer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-07-01T17:18:21,181 copying build/lib/deepspeed/ops/quantizer/quantizer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/quantizer 2021-07-01T17:18:21,184 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc 2021-07-01T17:18:21,185 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-07-01T17:18:21,187 copying build/lib/deepspeed/ops/csrc/sparse_attention/utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/sparse_attention 2021-07-01T17:18:21,190 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-07-01T17:18:21,191 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-07-01T17:18:21,194 copying build/lib/deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/lamb 2021-07-01T17:18:21,197 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-01T17:18:21,198 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_apply.cuh -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-01T17:18:21,201 copying build/lib/deepspeed/ops/csrc/adam/compat.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-01T17:18:21,204 copying build/lib/deepspeed/ops/csrc/adam/cpu_adam.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-01T17:18:21,207 copying build/lib/deepspeed/ops/csrc/adam/custom_cuda_kernel.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-01T17:18:21,209 copying build/lib/deepspeed/ops/csrc/adam/multi_tensor_adam.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-01T17:18:21,212 copying build/lib/deepspeed/ops/csrc/adam/fused_adam_frontend.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/adam 2021-07-01T17:18:21,215 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio 2021-07-01T17:18:21,217 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,218 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,220 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,223 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,225 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,227 copying build/lib/deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,230 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,232 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,235 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,237 copying build/lib/deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/py_lib 2021-07-01T17:18:21,241 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:21,242 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:21,250 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:21,252 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:21,255 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:21,257 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:21,260 copying build/lib/deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/aio/common 2021-07-01T17:18:21,263 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,264 copying build/lib/deepspeed/ops/csrc/includes/cpu_adam.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,267 copying build/lib/deepspeed/ops/csrc/includes/gemm_test.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,270 copying build/lib/deepspeed/ops/csrc/includes/general_kernels.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,272 copying build/lib/deepspeed/ops/csrc/includes/feed_forward.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,275 copying build/lib/deepspeed/ops/csrc/includes/StopWatch.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,277 copying build/lib/deepspeed/ops/csrc/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,280 copying build/lib/deepspeed/ops/csrc/includes/softmax.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,282 copying build/lib/deepspeed/ops/csrc/includes/ds_transformer_cuda.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,285 copying build/lib/deepspeed/ops/csrc/includes/strided_batch_gemm.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,287 copying build/lib/deepspeed/ops/csrc/includes/gelu.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,290 copying build/lib/deepspeed/ops/csrc/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,293 copying build/lib/deepspeed/ops/csrc/includes/type_shim.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,295 copying build/lib/deepspeed/ops/csrc/includes/quantizer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,297 copying build/lib/deepspeed/ops/csrc/includes/Timer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,300 copying build/lib/deepspeed/ops/csrc/includes/dropout.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,302 copying build/lib/deepspeed/ops/csrc/includes/normalize_layer.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,305 copying build/lib/deepspeed/ops/csrc/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/includes 2021-07-01T17:18:21,309 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-07-01T17:18:21,310 copying build/lib/deepspeed/ops/csrc/quantization/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-07-01T17:18:21,312 copying build/lib/deepspeed/ops/csrc/quantization/quantizer.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/quantization 2021-07-01T17:18:21,317 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-07-01T17:18:21,318 copying build/lib/deepspeed/ops/csrc/utils/flatten_unflatten.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/utils 2021-07-01T17:18:21,321 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-01T17:18:21,322 copying build/lib/deepspeed/ops/csrc/transformer/transform_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-01T17:18:21,326 copying build/lib/deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-01T17:18:21,330 copying build/lib/deepspeed/ops/csrc/transformer/cublas_wrappers.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-01T17:18:21,333 copying build/lib/deepspeed/ops/csrc/transformer/gelu_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-01T17:18:21,337 copying build/lib/deepspeed/ops/csrc/transformer/general_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-01T17:18:21,340 copying build/lib/deepspeed/ops/csrc/transformer/dropout_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-01T17:18:21,343 copying build/lib/deepspeed/ops/csrc/transformer/softmax_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-01T17:18:21,347 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference 2021-07-01T17:18:21,349 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-07-01T17:18:21,350 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/context.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-07-01T17:18:21,352 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-07-01T17:18:21,354 copying build/lib/deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/includes 2021-07-01T17:18:21,358 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:21,359 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:21,363 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:21,366 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:21,368 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:21,371 copying build/lib/deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer/inference/csrc 2021-07-01T17:18:21,374 copying build/lib/deepspeed/ops/csrc/transformer/normalize_kernels.cu -> build/bdist.linux-armv7l/wheel/deepspeed/ops/csrc/transformer 2021-07-01T17:18:21,380 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-07-01T17:18:21,381 copying build/lib/deepspeed/ops/transformer/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-07-01T17:18:21,384 creating build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-07-01T17:18:21,385 copying build/lib/deepspeed/ops/transformer/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-07-01T17:18:21,387 copying build/lib/deepspeed/ops/transformer/inference/transformer_inference.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer/inference 2021-07-01T17:18:21,390 copying build/lib/deepspeed/ops/transformer/transformer.py -> build/bdist.linux-armv7l/wheel/deepspeed/ops/transformer 2021-07-01T17:18:21,394 copying build/lib/deepspeed/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-01T17:18:21,397 creating build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-01T17:18:21,398 copying build/lib/deepspeed/elasticity/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-01T17:18:21,400 copying build/lib/deepspeed/elasticity/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-01T17:18:21,402 copying build/lib/deepspeed/elasticity/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-01T17:18:21,404 copying build/lib/deepspeed/elasticity/elasticity.py -> build/bdist.linux-armv7l/wheel/deepspeed/elasticity 2021-07-01T17:18:21,409 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-07-01T17:18:21,410 copying build/lib/deepspeed/profiling/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-07-01T17:18:21,412 copying build/lib/deepspeed/profiling/config.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-07-01T17:18:21,414 creating build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-07-01T17:18:21,415 copying build/lib/deepspeed/profiling/flops_profiler/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-07-01T17:18:21,418 copying build/lib/deepspeed/profiling/flops_profiler/profiler.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling/flops_profiler 2021-07-01T17:18:21,421 copying build/lib/deepspeed/profiling/constants.py -> build/bdist.linux-armv7l/wheel/deepspeed/profiling 2021-07-01T17:18:21,424 creating build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-07-01T17:18:21,425 copying build/lib/deepspeed/inference/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-07-01T17:18:21,427 copying build/lib/deepspeed/inference/engine.py -> build/bdist.linux-armv7l/wheel/deepspeed/inference 2021-07-01T17:18:21,430 copying build/lib/deepspeed/env_report.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-01T17:18:21,432 copying build/lib/deepspeed/git_version_info_installed.py -> build/bdist.linux-armv7l/wheel/deepspeed 2021-07-01T17:18:21,435 creating build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-01T17:18:21,436 copying build/lib/deepspeed/utils/__init__.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-01T17:18:21,438 copying build/lib/deepspeed/utils/timer.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-01T17:18:21,441 copying build/lib/deepspeed/utils/zero_to_fp32.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-01T17:18:21,443 copying build/lib/deepspeed/utils/logging.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-01T17:18:21,446 copying build/lib/deepspeed/utils/debug.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-01T17:18:21,448 copying build/lib/deepspeed/utils/distributed.py -> build/bdist.linux-armv7l/wheel/deepspeed/utils 2021-07-01T17:18:21,450 running install_egg_info 2021-07-01T17:18:21,460 Copying deepspeed.egg-info to build/bdist.linux-armv7l/wheel/deepspeed-0.4.2-py3.7.egg-info 2021-07-01T17:18:21,476 running install_scripts 2021-07-01T17:18:21,533 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data 2021-07-01T17:18:21,533 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts 2021-07-01T17:18:21,535 copying build/scripts-3.7/deepspeed.pt -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts 2021-07-01T17:18:21,537 copying build/scripts-3.7/ds_report -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts 2021-07-01T17:18:21,539 copying build/scripts-3.7/ds -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts 2021-07-01T17:18:21,541 copying build/scripts-3.7/ds_elastic -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts 2021-07-01T17:18:21,543 copying build/scripts-3.7/deepspeed -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts 2021-07-01T17:18:21,545 copying build/scripts-3.7/ds_ssh -> build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts 2021-07-01T17:18:21,546 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts/deepspeed.pt to 755 2021-07-01T17:18:21,546 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts/ds_report to 755 2021-07-01T17:18:21,547 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts/ds to 755 2021-07-01T17:18:21,547 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts/ds_elastic to 755 2021-07-01T17:18:21,547 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts/deepspeed to 755 2021-07-01T17:18:21,548 changing mode of build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.data/scripts/ds_ssh to 755 2021-07-01T17:18:21,617 adding license file "LICENSE" (matched pattern "LICEN[CS]E*") 2021-07-01T17:18:21,622 creating build/bdist.linux-armv7l/wheel/deepspeed-0.4.2.dist-info/WHEEL 2021-07-01T17:18:21,625 creating '/tmp/pip-wheel-jedfy5ke/deepspeed-0.4.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2021-07-01T17:18:21,629 adding 'deepspeed/__init__.py' 2021-07-01T17:18:21,630 adding 'deepspeed/constants.py' 2021-07-01T17:18:21,632 adding 'deepspeed/env_report.py' 2021-07-01T17:18:21,633 adding 'deepspeed/git_version_info.py' 2021-07-01T17:18:21,634 adding 'deepspeed/git_version_info_installed.py' 2021-07-01T17:18:21,636 adding 'deepspeed/elasticity/__init__.py' 2021-07-01T17:18:21,637 adding 'deepspeed/elasticity/config.py' 2021-07-01T17:18:21,639 adding 'deepspeed/elasticity/constants.py' 2021-07-01T17:18:21,641 adding 'deepspeed/elasticity/elasticity.py' 2021-07-01T17:18:21,643 adding 'deepspeed/inference/__init__.py' 2021-07-01T17:18:21,645 adding 'deepspeed/inference/engine.py' 2021-07-01T17:18:21,647 adding 'deepspeed/launcher/__init__.py' 2021-07-01T17:18:21,648 adding 'deepspeed/launcher/constants.py' 2021-07-01T17:18:21,650 adding 'deepspeed/launcher/launch.py' 2021-07-01T17:18:21,651 adding 'deepspeed/launcher/multinode_runner.py' 2021-07-01T17:18:21,654 adding 'deepspeed/launcher/runner.py' 2021-07-01T17:18:21,656 adding 'deepspeed/module_inject/__init__.py' 2021-07-01T17:18:21,657 adding 'deepspeed/module_inject/inject.py' 2021-07-01T17:18:21,659 adding 'deepspeed/module_inject/module_quantize.py' 2021-07-01T17:18:21,661 adding 'deepspeed/module_inject/replace_module.py' 2021-07-01T17:18:21,663 adding 'deepspeed/module_inject/replace_policy.py' 2021-07-01T17:18:21,665 adding 'deepspeed/ops/__init__.py' 2021-07-01T17:18:21,667 adding 'deepspeed/ops/adam/__init__.py' 2021-07-01T17:18:21,669 adding 'deepspeed/ops/adam/cpu_adam.py' 2021-07-01T17:18:21,671 adding 'deepspeed/ops/adam/fused_adam.py' 2021-07-01T17:18:21,672 adding 'deepspeed/ops/adam/multi_tensor_apply.py' 2021-07-01T17:18:21,674 adding 'deepspeed/ops/aio/__init__.py' 2021-07-01T17:18:21,677 adding 'deepspeed/ops/csrc/adam/compat.h' 2021-07-01T17:18:21,680 adding 'deepspeed/ops/csrc/adam/cpu_adam.cpp' 2021-07-01T17:18:21,681 adding 'deepspeed/ops/csrc/adam/custom_cuda_kernel.cu' 2021-07-01T17:18:21,682 adding 'deepspeed/ops/csrc/adam/fused_adam_frontend.cpp' 2021-07-01T17:18:21,684 adding 'deepspeed/ops/csrc/adam/multi_tensor_adam.cu' 2021-07-01T17:18:21,686 adding 'deepspeed/ops/csrc/adam/multi_tensor_apply.cuh' 2021-07-01T17:18:21,689 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.cpp' 2021-07-01T17:18:21,690 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_common.h' 2021-07-01T17:18:21,692 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.cpp' 2021-07-01T17:18:21,693 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_types.h' 2021-07-01T17:18:21,695 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.cpp' 2021-07-01T17:18:21,696 adding 'deepspeed/ops/csrc/aio/common/deepspeed_aio_utils.h' 2021-07-01T17:18:21,698 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.cpp' 2021-07-01T17:18:21,700 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_aio_thread.h' 2021-07-01T17:18:21,701 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.cpp' 2021-07-01T17:18:21,703 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio.h' 2021-07-01T17:18:21,704 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.cpp' 2021-07-01T17:18:21,706 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_aio_handle.h' 2021-07-01T17:18:21,707 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.cpp' 2021-07-01T17:18:21,709 adding 'deepspeed/ops/csrc/aio/py_lib/deepspeed_py_copy.h' 2021-07-01T17:18:21,710 adding 'deepspeed/ops/csrc/aio/py_lib/py_ds_aio.cpp' 2021-07-01T17:18:21,712 adding 'deepspeed/ops/csrc/includes/StopWatch.h' 2021-07-01T17:18:21,713 adding 'deepspeed/ops/csrc/includes/Timer.h' 2021-07-01T17:18:21,715 adding 'deepspeed/ops/csrc/includes/context.h' 2021-07-01T17:18:21,717 adding 'deepspeed/ops/csrc/includes/cpu_adam.h' 2021-07-01T17:18:21,718 adding 'deepspeed/ops/csrc/includes/cublas_wrappers.h' 2021-07-01T17:18:21,720 adding 'deepspeed/ops/csrc/includes/custom_cuda_layers.h' 2021-07-01T17:18:21,721 adding 'deepspeed/ops/csrc/includes/dropout.h' 2021-07-01T17:18:21,723 adding 'deepspeed/ops/csrc/includes/ds_transformer_cuda.h' 2021-07-01T17:18:21,724 adding 'deepspeed/ops/csrc/includes/feed_forward.h' 2021-07-01T17:18:21,725 adding 'deepspeed/ops/csrc/includes/gelu.h' 2021-07-01T17:18:21,727 adding 'deepspeed/ops/csrc/includes/gemm_test.h' 2021-07-01T17:18:21,729 adding 'deepspeed/ops/csrc/includes/general_kernels.h' 2021-07-01T17:18:21,730 adding 'deepspeed/ops/csrc/includes/normalize_layer.h' 2021-07-01T17:18:21,731 adding 'deepspeed/ops/csrc/includes/quantizer.h' 2021-07-01T17:18:21,733 adding 'deepspeed/ops/csrc/includes/softmax.h' 2021-07-01T17:18:21,734 adding 'deepspeed/ops/csrc/includes/strided_batch_gemm.h' 2021-07-01T17:18:21,736 adding 'deepspeed/ops/csrc/includes/type_shim.h' 2021-07-01T17:18:21,738 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda.cpp' 2021-07-01T17:18:21,740 adding 'deepspeed/ops/csrc/lamb/fused_lamb_cuda_kernel.cu' 2021-07-01T17:18:21,742 adding 'deepspeed/ops/csrc/quantization/pt_binding.cpp' 2021-07-01T17:18:21,745 adding 'deepspeed/ops/csrc/quantization/quantizer.cu' 2021-07-01T17:18:21,748 adding 'deepspeed/ops/csrc/sparse_attention/utils.cpp' 2021-07-01T17:18:21,750 adding 'deepspeed/ops/csrc/transformer/cublas_wrappers.cu' 2021-07-01T17:18:21,753 adding 'deepspeed/ops/csrc/transformer/dropout_kernels.cu' 2021-07-01T17:18:21,758 adding 'deepspeed/ops/csrc/transformer/ds_transformer_cuda.cpp' 2021-07-01T17:18:21,760 adding 'deepspeed/ops/csrc/transformer/gelu_kernels.cu' 2021-07-01T17:18:21,762 adding 'deepspeed/ops/csrc/transformer/general_kernels.cu' 2021-07-01T17:18:21,767 adding 'deepspeed/ops/csrc/transformer/normalize_kernels.cu' 2021-07-01T17:18:21,770 adding 'deepspeed/ops/csrc/transformer/softmax_kernels.cu' 2021-07-01T17:18:21,773 adding 'deepspeed/ops/csrc/transformer/transform_kernels.cu' 2021-07-01T17:18:21,776 adding 'deepspeed/ops/csrc/transformer/inference/csrc/dequantize.cu' 2021-07-01T17:18:21,777 adding 'deepspeed/ops/csrc/transformer/inference/csrc/gelu.cu' 2021-07-01T17:18:21,779 adding 'deepspeed/ops/csrc/transformer/inference/csrc/normalize.cu' 2021-07-01T17:18:21,782 adding 'deepspeed/ops/csrc/transformer/inference/csrc/pt_binding.cpp' 2021-07-01T17:18:21,784 adding 'deepspeed/ops/csrc/transformer/inference/csrc/softmax.cu' 2021-07-01T17:18:21,786 adding 'deepspeed/ops/csrc/transformer/inference/includes/context.h' 2021-07-01T17:18:21,788 adding 'deepspeed/ops/csrc/transformer/inference/includes/cublas_wrappers.h' 2021-07-01T17:18:21,789 adding 'deepspeed/ops/csrc/transformer/inference/includes/custom_cuda_layers.h' 2021-07-01T17:18:21,791 adding 'deepspeed/ops/csrc/utils/flatten_unflatten.cpp' 2021-07-01T17:18:21,793 adding 'deepspeed/ops/lamb/__init__.py' 2021-07-01T17:18:21,794 adding 'deepspeed/ops/lamb/fused_lamb.py' 2021-07-01T17:18:21,797 adding 'deepspeed/ops/op_builder/__init__.py' 2021-07-01T17:18:21,798 adding 'deepspeed/ops/op_builder/async_io.py' 2021-07-01T17:18:21,800 adding 'deepspeed/ops/op_builder/builder.py' 2021-07-01T17:18:21,802 adding 'deepspeed/ops/op_builder/cpu_adam.py' 2021-07-01T17:18:21,803 adding 'deepspeed/ops/op_builder/fused_adam.py' 2021-07-01T17:18:21,804 adding 'deepspeed/ops/op_builder/fused_lamb.py' 2021-07-01T17:18:21,805 adding 'deepspeed/ops/op_builder/quantizer.py' 2021-07-01T17:18:21,807 adding 'deepspeed/ops/op_builder/sparse_attn.py' 2021-07-01T17:18:21,808 adding 'deepspeed/ops/op_builder/stochastic_transformer.py' 2021-07-01T17:18:21,809 adding 'deepspeed/ops/op_builder/transformer.py' 2021-07-01T17:18:21,810 adding 'deepspeed/ops/op_builder/transformer_inference.py' 2021-07-01T17:18:21,812 adding 'deepspeed/ops/op_builder/utils.py' 2021-07-01T17:18:21,813 adding 'deepspeed/ops/quantizer/__init__.py' 2021-07-01T17:18:21,815 adding 'deepspeed/ops/quantizer/quantizer.py' 2021-07-01T17:18:21,817 adding 'deepspeed/ops/sparse_attention/__init__.py' 2021-07-01T17:18:21,818 adding 'deepspeed/ops/sparse_attention/bert_sparse_self_attention.py' 2021-07-01T17:18:21,821 adding 'deepspeed/ops/sparse_attention/matmul.py' 2021-07-01T17:18:21,823 adding 'deepspeed/ops/sparse_attention/softmax.py' 2021-07-01T17:18:21,826 adding 'deepspeed/ops/sparse_attention/sparse_attention_utils.py' 2021-07-01T17:18:21,827 adding 'deepspeed/ops/sparse_attention/sparse_self_attention.py' 2021-07-01T17:18:21,831 adding 'deepspeed/ops/sparse_attention/sparsity_config.py' 2021-07-01T17:18:21,833 adding 'deepspeed/ops/sparse_attention/trsrc/__init__.py' 2021-07-01T17:18:21,835 adding 'deepspeed/ops/sparse_attention/trsrc/matmul.tr' 2021-07-01T17:18:21,836 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_bwd.tr' 2021-07-01T17:18:21,837 adding 'deepspeed/ops/sparse_attention/trsrc/softmax_fwd.tr' 2021-07-01T17:18:21,839 adding 'deepspeed/ops/transformer/__init__.py' 2021-07-01T17:18:21,842 adding 'deepspeed/ops/transformer/transformer.py' 2021-07-01T17:18:21,844 adding 'deepspeed/ops/transformer/inference/__init__.py' 2021-07-01T17:18:21,847 adding 'deepspeed/ops/transformer/inference/transformer_inference.py' 2021-07-01T17:18:21,849 adding 'deepspeed/pipe/__init__.py' 2021-07-01T17:18:21,850 adding 'deepspeed/profiling/__init__.py' 2021-07-01T17:18:21,852 adding 'deepspeed/profiling/config.py' 2021-07-01T17:18:21,853 adding 'deepspeed/profiling/constants.py' 2021-07-01T17:18:21,855 adding 'deepspeed/profiling/flops_profiler/__init__.py' 2021-07-01T17:18:21,859 adding 'deepspeed/profiling/flops_profiler/profiler.py' 2021-07-01T17:18:21,862 adding 'deepspeed/runtime/__init__.py' 2021-07-01T17:18:21,866 adding 'deepspeed/runtime/config.py' 2021-07-01T17:18:21,867 adding 'deepspeed/runtime/config_utils.py' 2021-07-01T17:18:21,869 adding 'deepspeed/runtime/constants.py' 2021-07-01T17:18:21,871 adding 'deepspeed/runtime/csr_tensor.py' 2021-07-01T17:18:21,872 adding 'deepspeed/runtime/dataloader.py' 2021-07-01T17:18:21,874 adding 'deepspeed/runtime/eigenvalue.py' 2021-07-01T17:18:21,883 adding 'deepspeed/runtime/engine.py' 2021-07-01T17:18:21,887 adding 'deepspeed/runtime/lr_schedules.py' 2021-07-01T17:18:21,889 adding 'deepspeed/runtime/progressive_layer_drop.py' 2021-07-01T17:18:21,891 adding 'deepspeed/runtime/quantize.py' 2021-07-01T17:18:21,893 adding 'deepspeed/runtime/state_dict_factory.py' 2021-07-01T17:18:21,896 adding 'deepspeed/runtime/utils.py' 2021-07-01T17:18:21,897 adding 'deepspeed/runtime/weight_quantizer.py' 2021-07-01T17:18:21,899 adding 'deepspeed/runtime/activation_checkpointing/__init__.py' 2021-07-01T17:18:21,903 adding 'deepspeed/runtime/activation_checkpointing/checkpointing.py' 2021-07-01T17:18:21,904 adding 'deepspeed/runtime/activation_checkpointing/config.py' 2021-07-01T17:18:21,906 adding 'deepspeed/runtime/comm/__init__.py' 2021-07-01T17:18:21,908 adding 'deepspeed/runtime/comm/mpi.py' 2021-07-01T17:18:21,910 adding 'deepspeed/runtime/comm/nccl.py' 2021-07-01T17:18:21,911 adding 'deepspeed/runtime/compression/__init__.py' 2021-07-01T17:18:21,912 adding 'deepspeed/runtime/compression/cupy.py' 2021-07-01T17:18:21,914 adding 'deepspeed/runtime/fp16/__init__.py' 2021-07-01T17:18:21,916 adding 'deepspeed/runtime/fp16/fused_optimizer.py' 2021-07-01T17:18:21,918 adding 'deepspeed/runtime/fp16/loss_scaler.py' 2021-07-01T17:18:21,921 adding 'deepspeed/runtime/fp16/unfused_optimizer.py' 2021-07-01T17:18:21,922 adding 'deepspeed/runtime/fp16/onebit/__init__.py' 2021-07-01T17:18:21,924 adding 'deepspeed/runtime/fp16/onebit/adam.py' 2021-07-01T17:18:21,927 adding 'deepspeed/runtime/fp16/onebit/lamb.py' 2021-07-01T17:18:21,929 adding 'deepspeed/runtime/pipe/__init__.py' 2021-07-01T17:18:21,935 adding 'deepspeed/runtime/pipe/engine.py' 2021-07-01T17:18:21,938 adding 'deepspeed/runtime/pipe/module.py' 2021-07-01T17:18:21,940 adding 'deepspeed/runtime/pipe/p2p.py' 2021-07-01T17:18:21,942 adding 'deepspeed/runtime/pipe/schedule.py' 2021-07-01T17:18:21,944 adding 'deepspeed/runtime/pipe/topology.py' 2021-07-01T17:18:21,946 adding 'deepspeed/runtime/swap_tensor/__init__.py' 2021-07-01T17:18:21,947 adding 'deepspeed/runtime/swap_tensor/aio_config.py' 2021-07-01T17:18:21,949 adding 'deepspeed/runtime/swap_tensor/async_swapper.py' 2021-07-01T17:18:21,950 adding 'deepspeed/runtime/swap_tensor/constants.py' 2021-07-01T17:18:21,952 adding 'deepspeed/runtime/swap_tensor/optimizer_utils.py' 2021-07-01T17:18:21,954 adding 'deepspeed/runtime/swap_tensor/partitioned_optimizer_swapper.py' 2021-07-01T17:18:21,957 adding 'deepspeed/runtime/swap_tensor/partitioned_param_swapper.py' 2021-07-01T17:18:21,959 adding 'deepspeed/runtime/swap_tensor/pipelined_optimizer_swapper.py' 2021-07-01T17:18:21,960 adding 'deepspeed/runtime/swap_tensor/utils.py' 2021-07-01T17:18:21,962 adding 'deepspeed/runtime/zero/__init__.py' 2021-07-01T17:18:21,964 adding 'deepspeed/runtime/zero/config.py' 2021-07-01T17:18:21,965 adding 'deepspeed/runtime/zero/constants.py' 2021-07-01T17:18:21,967 adding 'deepspeed/runtime/zero/contiguous_memory_allocator.py' 2021-07-01T17:18:21,969 adding 'deepspeed/runtime/zero/linear.py' 2021-07-01T17:18:21,970 adding 'deepspeed/runtime/zero/offload_config.py' 2021-07-01T17:18:21,971 adding 'deepspeed/runtime/zero/offload_constants.py' 2021-07-01T17:18:21,977 adding 'deepspeed/runtime/zero/partition_parameters.py' 2021-07-01T17:18:21,983 adding 'deepspeed/runtime/zero/stage1.py' 2021-07-01T17:18:21,994 adding 'deepspeed/runtime/zero/stage2.py' 2021-07-01T17:18:22,012 adding 'deepspeed/runtime/zero/stage3.py' 2021-07-01T17:18:22,014 adding 'deepspeed/runtime/zero/test.py' 2021-07-01T17:18:22,016 adding 'deepspeed/runtime/zero/tiling.py' 2021-07-01T17:18:22,017 adding 'deepspeed/runtime/zero/utils.py' 2021-07-01T17:18:22,019 adding 'deepspeed/utils/__init__.py' 2021-07-01T17:18:22,020 adding 'deepspeed/utils/debug.py' 2021-07-01T17:18:22,021 adding 'deepspeed/utils/distributed.py' 2021-07-01T17:18:22,022 adding 'deepspeed/utils/logging.py' 2021-07-01T17:18:22,024 adding 'deepspeed/utils/timer.py' 2021-07-01T17:18:22,025 adding 'deepspeed/utils/zero_to_fp32.py' 2021-07-01T17:18:22,028 adding 'deepspeed-0.4.2.data/scripts/deepspeed' 2021-07-01T17:18:22,029 adding 'deepspeed-0.4.2.data/scripts/deepspeed.pt' 2021-07-01T17:18:22,030 adding 'deepspeed-0.4.2.data/scripts/ds' 2021-07-01T17:18:22,031 adding 'deepspeed-0.4.2.data/scripts/ds_elastic' 2021-07-01T17:18:22,032 adding 'deepspeed-0.4.2.data/scripts/ds_report' 2021-07-01T17:18:22,033 adding 'deepspeed-0.4.2.data/scripts/ds_ssh' 2021-07-01T17:18:22,036 adding 'op_builder/__init__.py' 2021-07-01T17:18:22,037 adding 'op_builder/async_io.py' 2021-07-01T17:18:22,039 adding 'op_builder/builder.py' 2021-07-01T17:18:22,040 adding 'op_builder/cpu_adam.py' 2021-07-01T17:18:22,041 adding 'op_builder/fused_adam.py' 2021-07-01T17:18:22,043 adding 'op_builder/fused_lamb.py' 2021-07-01T17:18:22,044 adding 'op_builder/quantizer.py' 2021-07-01T17:18:22,045 adding 'op_builder/sparse_attn.py' 2021-07-01T17:18:22,046 adding 'op_builder/stochastic_transformer.py' 2021-07-01T17:18:22,047 adding 'op_builder/transformer.py' 2021-07-01T17:18:22,048 adding 'op_builder/transformer_inference.py' 2021-07-01T17:18:22,050 adding 'op_builder/utils.py' 2021-07-01T17:18:22,051 adding 'deepspeed-0.4.2.dist-info/LICENSE' 2021-07-01T17:18:22,053 adding 'deepspeed-0.4.2.dist-info/METADATA' 2021-07-01T17:18:22,054 adding 'deepspeed-0.4.2.dist-info/WHEEL' 2021-07-01T17:18:22,055 adding 'deepspeed-0.4.2.dist-info/entry_points.txt' 2021-07-01T17:18:22,056 adding 'deepspeed-0.4.2.dist-info/top_level.txt' 2021-07-01T17:18:22,059 adding 'deepspeed-0.4.2.dist-info/RECORD' 2021-07-01T17:18:22,071 removing build/bdist.linux-armv7l/wheel 2021-07-01T17:18:22,141 deepspeed build time = 3.3077263832092285 secs 2021-07-01T17:18:22,214 Building wheel for deepspeed (setup.py): finished with status 'done' 2021-07-01T17:18:22,221 Created wheel for deepspeed: filename=deepspeed-0.4.2-py3-none-any.whl size=451771 sha256=b176a503257b9c9d245a96472abc29212d9955fe6d3e06dddca1985ea1012025 2021-07-01T17:18:22,222 Stored in directory: /tmp/pip-ephem-wheel-cache-1zopdr_2/wheels/2e/54/dc/4e03b2864605ed88f84bf963416b066c55cd79a77c6604d6c4 2021-07-01T17:18:22,244 Successfully built deepspeed 2021-07-01T17:18:22,269 Removed build tracker: '/tmp/pip-req-tracker-t92njsn8'