Metaflow 2.9.9+netflix-ext(0.2.3) executing LinearModelBuilderV2 for user:unmeshph debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/utils.py:128]: Conda root is at s3://metaflow-gamma-metaflows3bucket-1c3ffmsh65kgi/metaflow/conda_env Project: model_builder, Branch: user.unmeshph Validating your flow... The graph looks good! Running pylint... Pylint not found, so extra checks are disabled debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In conda decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In pip decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In conda decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In pip decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In conda decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In pip decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In conda decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In pip decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In conda decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In pip decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In conda decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In pip decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In conda decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:856]: In pip decorator: pip_base(True), conda_base(False), conda_deco(conda), pip_deco(pip) Bootstrapping Conda environment... (this could take a few minutes) debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:159]: Requested for step start: deps: [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12]; sources: [] debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:639]: EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64') not found locally debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:272]: Added environment to resolve {'id': EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64'), 'steps': ['start'], 'user_deps': [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12], 'deps': [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12], 'sources': [], 'extras': [], 'conda_format': ['.conda'], 'base': None, 'base_accurate': None, 'resolved': None, 'already_resolved': False, 'env_type': None, 'force': False} debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:159]: Requested for step load_train_data: deps: [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12]; sources: [] debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:639]: EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64') not found locally debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:278]: Environment 'EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64')' is also needed by 'load_train_data' debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:159]: Requested for step train: deps: [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12]; sources: [] debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:639]: EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64') not found locally debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:278]: Environment 'EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64')' is also needed by 'train' debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:159]: Requested for step load_test_data: deps: [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12]; sources: [] debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:639]: EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64') not found locally debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:278]: Environment 'EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64')' is also needed by 'load_test_data' debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:159]: Requested for step test: deps: [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12]; sources: [] debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:639]: EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64') not found locally debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:278]: Environment 'EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64')' is also needed by 'test' debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:159]: Requested for step deploy: deps: [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12]; sources: [] debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:639]: EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64') not found locally debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:278]: Environment 'EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64')' is also needed by 'deploy' debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda_step_decorator.py:159]: Requested for step end: deps: [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12]; sources: [] debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:639]: EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64') not found locally debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:278]: Environment 'EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64')' is also needed by 'end' debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:298]: Resolving environments: debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:301]: 975e603f99eca8a06a3b7fe13511f224bbc0c11a (_default): {'id': EnvID(req_id='975e603f99eca8a06a3b7fe13511f224bbc0c11a', full_id='_default', arch='linux-64'), 'steps': ['start', 'load_train_data', 'train', 'load_test_data', 'test', 'deploy', 'end'], 'user_deps': [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12], 'deps': [pip::requests==>=2.21.0, pip::ether==0.1.149, pip::boto3==>=1.14.0, conda::python==3.10.12], 'sources': [], 'extras': [], 'conda_format': ['.conda'], 'base': None, 'base_accurate': None, 'resolved': None, 'already_resolved': False, 'env_type': None, 'force': False} Resolving 1 environment in flow ...debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:639]: EnvID(req_id='d9235ec4270baef705a985ab8127fd1373d59a7e', full_id='_default', arch='linux-64') not found locally debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/envsresolver.py:669]: Builder environments: {EnvID(req_id='d9235ec4270baef705a985ab8127fd1373d59a7e', full_id='_default', arch='linux-64'): {'id': EnvID(req_id='d9235ec4270baef705a985ab8127fd1373d59a7e', full_id='_default', arch='linux-64'), 'steps': ['start', 'load_train_data', 'train', 'load_test_data', 'test', 'deploy', 'end'], 'user_deps': [conda::python==3.10.12], 'deps': [conda::python==3.10.12], 'sources': [], 'extras': [], 'conda_format': ['.conda'], 'base': None, 'base_accurate': False, 'resolved': None, 'already_resolved': False, 'env_type': }} debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:317]: Environment is of type conda-only debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:3927]: Conda call: ['/home/unmeshph/miniforge3/bin/mamba', 'info', '--json'] debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:3927]: Conda call: ['/home/unmeshph/miniforge3/bin/mamba', 'create', '--prefix', '/tmp/tmpx18xefdu/prefix', '--dry-run', 'python==3.10.12'] debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:317]: Environment is of type pip-only debug[conda /local/home/unmeshph/.cache/pypoetry/virtualenvs/saitama-SKj-zWo--py3.10/lib/python3.10/site-packages/metaflow_extensions/netflix_ext/plugins/conda/conda.py:1984]: Creating builder conda environment