2022-02-25T20:07:01.094+0100 [INFO]: Data distribution worker started 2022-02-25T20:07:01.094+0100 [INFO]: Request id: "data_load_z6in0c7j1S_NeObaGrdIA:eqHFcd0trXdorIKh:EUueSIKtFwhDgGZq" 2022-02-25T20:07:01.094+0100 [INFO]: Data source: "6213a2f0715d230001cdf372" 2022-02-25T20:07:01.094+0100 [INFO]: Additional parameters: {GDC_DATALOAD_DATASETS=[{"dataset":"dataset.branches","uploadMode":"FULL"},{"dataset":"dataset.companies","uploadMode":"FULL"},{"dataset":"dataset.crm_deal","uploadMode":"FULL"},{"dataset":"dataset.portal_users","uploadMode":"FULL"},{"dataset":"dataset.properties","uploadMode":"FULL"},{"dataset":"dataset.viewing_requests","uploadMode":"FULL"}], PROCESS_ID=47b1a526-35bf-4e9c-95ff-43f352137e2e} 2022-02-25T20:07:01.094+0100 [INFO]: Synchronization mode: selected datasets (default) 2022-02-25T20:07:01.899+0100 [INFO]: Synchronized datasets: [dataset.companies, dataset.crm_deal, dataset.portal_users, dataset.properties, dataset.viewing_requests, dataset.branches] 2022-02-25T20:07:07.835+0100 [INFO]: ====================== Mapping Validation ====================== Mapping Validation is OK ====================== End of Mapping Validation ====================== 2022-02-25T20:07:07.837+0100 [INFO]: ====================== Output Stage -> LDM mapping ====================== Output Stage table/view: branches (full, shared) -> Dataset: dataset.branches admin_firstname[TEXT(2147483647)] -> label.branches.admin_firstname{LABEL}[VARCHAR(10000)] name[TEXT(2147483647)] -> label.branches.name{LABEL}[VARCHAR(10000)] id[SERIAL] -> label.branches.id{LABEL}[INT] admin_email[TEXT(2147483647)] -> label.branches.admin_email{LABEL}[VARCHAR(10000)] priority[INT2] -> fact.branches.priority{FACT}[INT] company_id[INT4] -> dataset.companies{REFERENCE}[INT] remote_id[INT4] -> label.branches.remoteid{LABEL}[VARCHAR(128)] notes[TEXT(2147483647)] -> label.branches.notes{LABEL}[VARCHAR(10000)] lettings_number[TEXT(2147483647)] -> label.branches.lettings_number{LABEL}[VARCHAR(10000)] address_line_two[VARCHAR(255)] -> label.branches.address_line_two{LABEL}[VARCHAR(255)] address_line_one[VARCHAR(255)] -> label.branches.address_line_one{LABEL}[VARCHAR(255)] sales_contact[TEXT(2147483647)] -> label.branches.sales_contact{LABEL}[VARCHAR(10000)] sales_number[TEXT(2147483647)] -> label.branches.sales_number{LABEL}[VARCHAR(10000)] trusted[BOOL] -> label.branches.trusted{LABEL}[VARCHAR(128)] admin_lastname[TEXT(2147483647)] -> label.branches.admin_lastname{LABEL}[VARCHAR(10000)] post_code[TEXT(2147483647)] -> label.branches.post_code{LABEL}[VARCHAR(10000)] lettings_contact[TEXT(2147483647)] -> label.branches.lettings_contact{LABEL}[VARCHAR(10000)] Output Stage table/view: companies (full, shared) -> Dataset: dataset.companies origin[TEXT(2147483647)] -> label.companies.origin{LABEL}[VARCHAR(10000)] logo[VARCHAR(100)] -> label.companies.logo{LABEL}[VARCHAR(100)] id[SERIAL] -> label.companies.id{LABEL}[INT] is_franchise[BOOL] -> label.companies.is_franchise{LABEL}[VARCHAR(128)] name[VARCHAR(255)] -> label.companies.name{LABEL}[VARCHAR(255)] remote_id[INT4] -> label.companies.remoteid{LABEL}[VARCHAR(128)] Output Stage table/view: crm_deal (full, shared) -> Dataset: dataset.crm_deal stage[VARCHAR(255)] -> label.crm_deal.stage{LABEL}[VARCHAR(255)] type_of_viewing[TEXT(2147483647)] -> label.crm_deal.type_of_viewing{LABEL}[VARCHAR(10000)] deal_status_msg[TEXT(2147483647)] -> label.crm_deal.deal_status_msg{LABEL}[VARCHAR(10000)] blocked_reason[TEXT(2147483647)] -> label.crm_deal.blocked_reason{LABEL}[VARCHAR(10000)] property_id[INT4] -> label.crm_deal.property_id{LABEL}[VARCHAR(128)] time_spent_blocked[INTERVAL] -> fact.crm_deal.timespentblocked{FACT}[DECIMAL(12,2)] is_archived[BOOL] -> label.crm_deal.is_archived{LABEL}[VARCHAR(128)] contact_tel_sales[VARCHAR(255)] -> label.crm_deal.contact_tel_sales{LABEL}[VARCHAR(255)] updated_at[TIMESTAMPTZ] -> updatedat1{DATE}[DATE] agent_id[INT4] -> label.crm_deal.agent_id{LABEL}[VARCHAR(128)] id[SERIAL] -> label.crm_deal.id{LABEL}[INT] lost_reason[TEXT(2147483647)] -> label.crm_deal.lost_reason{LABEL}[VARCHAR(10000)] deal_offer[TEXT(2147483647)] -> label.crm_deal.deal_offer{LABEL}[VARCHAR(10000)] agent_action[VARCHAR(255)] -> label.crm_deal.agent_action{LABEL}[VARCHAR(255)] property_url[VARCHAR(255)] -> label.crm_deal.property_url{LABEL}[VARCHAR(255)] status[VARCHAR(255)] -> label.crm_deal.status{LABEL}[VARCHAR(255)] ops_issue[TEXT(2147483647)] -> label.crm_deal.ops_issue{LABEL}[VARCHAR(10000)] last_updated_by_agent_at[TIMESTAMPTZ] -> lastupdatedbyagentat{DATE}[DATE] time_spent_call_still_available[INTERVAL] -> fact.crm_deal.timespentcallstillavailable{FACT}[DECIMAL(12,2)] viewing_confirmed[BOOL] -> label.crm_deal.viewing_confirmed{LABEL}[VARCHAR(128)] created_at[TIMESTAMPTZ] -> createdat1{DATE}[DATE] enumerator[VARCHAR(255)] -> label.crm_deal.enumerator{LABEL}[VARCHAR(255)] is_weekend_request[BOOL] -> label.crm_deal.is_weekend_request{LABEL}[VARCHAR(128)] viewing_request_id[INT4] -> dataset.viewing_requests{REFERENCE}[INT] origin_id[INT4] -> label.crm_deal.originid{LABEL}[VARCHAR(128)] contact_person_lettings[VARCHAR(255)] -> label.crm_deal.contact_person_lettings{LABEL}[VARCHAR(255)] contact_person_sales[VARCHAR(255)] -> label.crm_deal.contact_person_sales{LABEL}[VARCHAR(255)] owner[VARCHAR(255)] -> label.crm_deal.owner{LABEL}[VARCHAR(255)] contact_tel_lettings[VARCHAR(255)] -> label.crm_deal.contact_tel_lettings{LABEL}[VARCHAR(255)] time_spent_call_debrief_viewing[INTERVAL] -> fact.crm_deal.timespentcalldebriefviewing{FACT}[DECIMAL(12,2)] property_address[VARCHAR(255)] -> label.crm_deal.property_address{LABEL}[VARCHAR(255)] Output Stage table/view: portal_users (full, shared) -> Dataset: dataset.portal_users login_count[INT4] -> fact.portal_users.login_count{FACT}[INT] submitted_needs_count[INT4] -> fact.portal_users.submitted_needs_count{FACT}[INT] max_salary[VARCHAR(2147483647)] -> label.portal_users.max_salary{LABEL}[VARCHAR(10000)] notes[TEXT(2147483647)] -> label.portal_users.notes{LABEL}[VARCHAR(10000)] lastname[VARCHAR(255)] -> label.portal_users.lastname{LABEL}[VARCHAR(255)] meets_income_criteria[BOOL] -> label.portal_users.meets_income_criteria{LABEL}[VARCHAR(128)] quality_score[INT2] -> label.portal_users.qualityscore{LABEL}[INT] id[SERIAL] -> label.portal_users.id{LABEL}[INT] has_favourited[BOOL] -> label.portal_users.has_favourited{LABEL}[VARCHAR(128)] email[VARCHAR(255)] -> label.portal_users.email{LABEL}[VARCHAR(255)] contact_number[VARCHAR(255)] -> label.portal_users.contact_number{LABEL}[VARCHAR(255)] town[VARCHAR(255)] -> label.portal_users.town{LABEL}[VARCHAR(255)] requested_viewing[INT4] -> fact.portal_users.requested_viewing{FACT}[INT] salary[VARCHAR(2147483647)] -> label.portal_users.salary{LABEL}[VARCHAR(10000)] clicked_property_card[INT4] -> fact.portal_users.clicked_property_card{FACT}[INT] user_submitted_default_needs[BOOL] -> label.portal_users.user_submitted_default_needs{LABEL}[VARCHAR(128)] archived[BOOL] -> label.portal_users.archived{LABEL}[VARCHAR(128)] mql_score[INT4] -> label.portal_users.mqlscore{LABEL}[VARCHAR(128)] pets[VARCHAR(255)] -> label.portal_users.pets{LABEL}[VARCHAR(255)] employment_status[VARCHAR(255)] -> label.portal_users.employment_status{LABEL}[VARCHAR(255)] min_salary[VARCHAR(2147483647)] -> label.portal_users.min_salary{LABEL}[VARCHAR(10000)] mql_score_maximum[INT2] -> label.portal_users.mqlscoremaximum{LABEL}[VARCHAR(128)] firstname[VARCHAR(255)] -> label.portal_users.firstname{LABEL}[VARCHAR(255)] meets_upfront_payment_criteria[BOOL] -> label.portal_users.meets_upfront_payment_criteria{LABEL}[VARCHAR(128)] financial_status[VARCHAR(255)] -> label.portal_users.financial_status{LABEL}[VARCHAR(255)] address_line_one[VARCHAR(255)] -> label.portal_users.address_line_one{LABEL}[VARCHAR(255)] meets_guarantor_criteria[BOOL] -> label.portal_users.meets_guarantor_criteria{LABEL}[VARCHAR(128)] job_title[VARCHAR(2147483647)] -> label.portal_users.job_title{LABEL}[VARCHAR(10000)] post_code[VARCHAR(255)] -> label.portal_users.post_code{LABEL}[VARCHAR(255)] viewed_shorlist_count[INT4] -> fact.portal_users.viewed_shorlist_count{FACT}[INT] facebook_email[VARCHAR(255)] -> label.portal_users.facebook_email{LABEL}[VARCHAR(255)] country[VARCHAR(255)] -> label.portal_users.country{LABEL}[VARCHAR(255)] meets_no_criteria[BOOL] -> label.portal_users.meets_no_criteria{LABEL}[VARCHAR(128)] moving_with[VARCHAR(255)] -> label.portal_users.moving_with{LABEL}[VARCHAR(255)] Output Stage table/view: properties (full, shared) -> Dataset: dataset.properties id[SERIAL] -> label.properties.id{LABEL}[INT] city[VARCHAR(255)] -> label.properties.city{LABEL}[VARCHAR(255)] allows_pets[BOOL] -> label.properties.allows_pets{LABEL}[VARCHAR(128)] band[INT2] -> fact.properties.band{FACT}[INT] property_type[VARCHAR(255)] -> label.properties.property_type{LABEL}[VARCHAR(255)] water_cost[INT4] -> fact.properties.water_cost{FACT}[INT] predicted_floor_area[FLOAT8] -> fact.properties.predicted_floor_area{FACT}[DECIMAL(12,2)] has_parking[BOOL] -> label.properties.has_parking{LABEL}[VARCHAR(128)] price[NUMERIC(10,2)] -> fact.properties.price{FACT}[DECIMAL(10,2)] electricity_cost[INT4] -> fact.properties.electricity_cost{FACT}[INT] has_garden[BOOL] -> label.properties.has_garden{LABEL}[VARCHAR(128)] video[VARCHAR(255)] -> label.properties.video{LABEL}[VARCHAR(255)] furnished_state[VARCHAR(255)] -> label.properties.furnished_state{LABEL}[VARCHAR(255)] allows_students[BOOL] -> label.properties.allows_students{LABEL}[VARCHAR(128)] longitude[NUMERIC(10,7)] -> fact.properties.longitude{FACT}[DECIMAL(10,7)] branch_id[INT4] -> dataset.branches{REFERENCE}[INT] council_tax_cost[INT4] -> fact.properties.council_tax_cost{FACT}[INT] location[GEOGRAPHY] -> label.properties.location{LABEL}[VARCHAR(128)] virtual_tour[VARCHAR(255)] -> label.properties.virtual_tour{LABEL}[VARCHAR(255)] has_lift[BOOL] -> label.properties.has_lift{LABEL}[VARCHAR(128)] post_code[TEXT(2147483647)] -> label.properties.post_code{LABEL}[VARCHAR(10000)] has_gym[BOOL] -> label.properties.has_gym{LABEL}[VARCHAR(128)] listing_status[TEXT(2147483647)] -> label.properties.listing_status{LABEL}[VARCHAR(10000)] predicted_number_of_bathrooms[INT2] -> fact.properties.predicted_number_of_bathrooms{FACT}[INT] status[TEXT(2147483647)] -> label.properties.status{LABEL}[VARCHAR(10000)] latitude[NUMERIC(10,7)] -> fact.properties.latitude{FACT}[DECIMAL(10,7)] is_furnished[BOOL] -> label.properties.is_furnished{LABEL}[VARCHAR(128)] floor_plan[JSONB] -> label.properties.floor_plan{LABEL}[VARCHAR(128)] is_shared[BOOL] -> label.properties.is_shared{LABEL}[VARCHAR(128)] num_bedrooms[INT4] -> fact.properties.num_bedrooms{FACT}[INT] num_floors[TEXT(2147483647)] -> label.properties.num_floors{LABEL}[VARCHAR(10000)] displayable_address[TEXT(2147483647)] -> label.properties.displayable_address{LABEL}[VARCHAR(10000)] num_recepts[TEXT(2147483647)] -> label.properties.num_recepts{LABEL}[VARCHAR(10000)] gas_cost[INT4] -> fact.properties.gas_cost{FACT}[INT] has_concierge[BOOL] -> label.properties.has_concierge{LABEL}[VARCHAR(128)] num_bathrooms[INT4] -> fact.properties.num_bathrooms{FACT}[INT] listing_id[VARCHAR(255)] -> label.properties.listing_id{LABEL}[VARCHAR(255)] has_pool[BOOL] -> label.properties.has_pool{LABEL}[VARCHAR(128)] property_subtype[VARCHAR(255)] -> label.properties.property_subtype{LABEL}[VARCHAR(255)] rental_prices[VARCHAR(2147483647)] -> label.properties.rental_prices{LABEL}[VARCHAR(10000)] Output Stage table/view: viewing_requests (full, shared) -> Dataset: dataset.viewing_requests property_id[INT4] -> dataset.properties{REFERENCE}[INT] createdAt[TIMESTAMPTZ] -> createdat{DATE}[DATE] id[SERIAL] -> label.viewing_requests.id{LABEL}[INT] user_id[INT4] -> dataset.portal_users{REFERENCE}[INT] ====================== End of Output Stage -> LDM mapping ====================== 2022-02-25T20:07:07.852+0100 [INFO]: ====================== Data distribution scope ====================== 2022-02-25T20:07:07.852+0100 [INFO]: Project="agec4eedvwssrhs3rmza3yc7yw0cwc5n"; datasets=[{dataset.companies, full, loadDataFrom=1970-01-01T00:00}, {dataset.crm_deal, full, loadDataFrom=1970-01-01T00:00}, {dataset.portal_users, full, loadDataFrom=1970-01-01T00:00}, {dataset.properties, full, loadDataFrom=1970-01-01T00:00}, {dataset.viewing_requests, full, loadDataFrom=1970-01-01T00:00}, {dataset.branches, full, loadDataFrom=1970-01-01T00:00}] 2022-02-25T20:07:07.853+0100 [INFO]: ====================== End of Data distribution scope ====================== 2022-02-25T20:07:07.854+0100 [INFO]: ====================== Downloading and integrating data ====================== 2022-02-25T20:09:12.895+0100 [INFO]: Data for project="agec4eedvwssrhs3rmza3yc7yw0cwc5n" was downloaded. Datasets: [{dataset.branches, upsert, rows=10055, size=408866 bytes}, {dataset.companies, upsert, rows=646, size=19708 bytes}, {dataset.crm_deal, upsert, rows=10592, size=4130786 bytes}, {dataset.portal_users, upsert, rows=18760, size=1904118 bytes}, {dataset.properties, upsert, rows=886574, size=287596238 bytes}, {dataset.viewing_requests, upsert, rows=16916, size=773557 bytes}] 2022-02-25T20:10:17.923+0100 [WARN]: Project "agec4eedvwssrhs3rmza3yc7yw0cwc5n" was not integrated. Reason: Upload to dataset dataset.portal_users failed with 'An error occured during loading of csv files: SQLSTATE_INVALID_TEXT_REPRESENTATION_PG. Details: invalid input syntax for type integer: ""'. 2022-02-25T20:10:27.929+0100 [INFO]: ====================== End of downloading and integrating data ====================== 2022-02-25T20:10:27.929+0100 [ERROR]: Data distribution worker failed. Reason: All projects failed to load.