TNC and Taxi Processed Daily Trips Data with Exogenous Variables

The City of Chicago has published trip-level data for every TNC trip since November 1, 2018. To the best of our knowledge, this dataset is the only one that includes trip fare variables. As we wrote this paper in Oct 2022, the dataset includes approximately 263 million trip records (rows) and 21 features (columns) for trips dated from November 1, 2018, through October 1, 2022. The features of this data include Trip ID, Trip Start Timestamp (rounded to the nearest 15 minutes), Trip End Timestamp (rounded to the nearest 15 minutes), Trip Seconds, Trip Miles, Pickup Census Tract, Dropoff Census Tract, Pickup Community Area, Drop Off Community Area, Trip Fare, Tip, Additional Charges, Total Trip Fare, Shared Trip Authorized, Trips Pooled, Pickup Centroid Latitude, Pickup Centroid Longitude, Pickup Centroid Location, Dropoff Centroid Latitude, Dropoff Centroid Longitude, Dropoff Centroid Location. As the dataset is too large to be processed without a supercomputer, we generated a random sample of 2 million trips from Nov 2018 to June 2022 with valid pickup and drop-down area information. To explore the data, we processed the features to extract date information from the timestamp. We created new variables, including each trip's average fare per mile (excluding tips and additional charges, mainly taxes). In dataset (1), the sampled TNC trips data was processed and summarized to include the average daily fare per mile (USD/mile), and exogenous variables that impact the price were added to the data including holidays (Christmas, thanksgiving, Independence Day, easter and new year) and other variables including gas prices, and climate (snow, precipitation, and average daily temperature). The City of Chicago also publishes taxi trips from 2013 to the present. To protect privacy but allow for aggregate analyses, the Taxi ID is consistent for any given taxi medallion number but does not show the number, and times are rounded to the nearest 15 minutes. Due to the data reporting process, not all but most trips are reported. Taxicabs in Chicago, Illinois, are operated by private companies and licensed by the city. About seven thousand licensed cabs are operating within the city limits. As the dataset is too large to be processed without a supercomputer, we generated a random sample of 2 million trips from Nov 2018 to June 2022 with valid pickup and drop-down area information. To explore the data, we processed the features to extract date information from the timestamp. We created new variables, including each trip's average fare per mile (excluding tips and additional charges, mainly taxes). In dataset (2), the taxi trips data was processed and summarized to include the average daily fare per mile (USD/mile), and exogenous variables that impact the price were added to the data including holidays (Christmas, thanksgiving, Independence Day, easter and new year) and other variables including gas prices, and climate (snow, precipitation, and average daily temperature).