FIT5196 Data wrangling Assignment

Assignment Help Python Programming
Reference no: EM132796745

 FIT5196 Data wrangling - Monash University

For this assessment, you are required to write Python code to integrate several datasets into one single schema and find and fix possible problems in the data. Input and output of this assessment are shown below:

Table 1. The input and output of the task

Inputs

Output

Jupyter notebook and pdf

shopingcenters.html, real_state.json, hospitals.xlsx, supermarkets.pdf, real_state.xml, Vic_suburb_boundary.zip,

GTFS_Melbourne_Train_Infor mation.zip

<student_no>_A3_solution.csv

<student_no>_ass3.ipynb

<student_no>_ass3.pdf

Task 1: Data Integration
In this task, you are required to integrate the input datasets (i.e., 7 datasets including hospitals, supermarkets, shopping centers, real estate files (one XML and one Json), Vic_suburb_boundary, and GTFS_Melbourne_Train_Information files) into one dataset with the following schema.

Table 2. Description of the final schema

COLUMN

DESCRIPTION

Property_id

A unique id for the property

lat

The property latitude

lng

The property longitude

addr_street

The property address

suburb (15%)

The property suburb. Default value: "not available"

price

The property price

property_type

The type of the property

year

Year of sold

bedrooms

Number of bedrooms

bathrooms

Number of bathrooms

parking_space

The number of parking space of the property

Shopping_center_id (5%)

The closest shopping centre to the property. Default value: "not available"

Distance_to_sc (5%)

The Haversine Distance (3 decimal places with +-0.001 tolerance) from the closest shopping centre to the property. Default value: 0

Train_station_id (10%)

The closest train station to the property. Default value: 0

Distance_to_train_st ation (5%)

The Haversine Distance (3 decimal places with +-0.001 tolerance) from the closest train station to the property. Default value: 0

travel_min_to_CBD (15%)

The average travel time (minutes) from the closest train station to the "Flinders street" station on weekdays (i.e. Monday-Friday) departing between 7 to 9 am. For example, if there are 3 trip departing from the closest train station to the Flinders street station on weekdays between 7-9am and each take 6, 7, and 8 minutes respectively, then the value of this column for the property should be (6+7+8)/3. If there are any direct transfers between the closest station and Flinders street station, only the average of direct transfers should be calculated. Default value: 0

Hospital_id (5%)

The closest hospital to the property. Default value: "not available"

Distance_to_hospital (5%)

The Haversine Distance (3 decimal places with +-0.001 tolerance) from the closest hospital to the property. Default value: 0

Supermarket_id (5%)

The closest supermarket to the property. Default value: "not available"

Distance_to_superm aket (5%)

The Haversine Distance (3 decimal places with +-0.001 tolerance) from the closest supermarket to the property. Default value: 0

Over_ave_price (15%)

The Boolean value to the property. Write a True value if the price is higher than the average house price of its suburb. Otherwise, the value should be False. The average house price of each property can be calculated by averaging the total house price of its suburb. Default value: 0

Task 2: Documentation

The main focus of the documentation would be on the quality of your explanation on task 1 but similar to the previous assignments, your notebook file should be in a decent format with proper sections and subsections.

Note 1: the output csv file must have the exact same columns as specified on the schema. Please note that the output files which are not in a correct format, as specified in the integrated schema, won't be marked.

Note 2: if you decide not to calculate any of the required columns, then you must have that column in your final dataframe with the ‘default value' as the value of all the rows. Please note that the output files which are not in a correct format, as specified in the integrated schema, won't be marked.

Note 3: No external data is allowed to calculate the values of the integrated schema. For example, to calculate the suburb, you can only use the shape files.

Note 4: the radius of the earth is still 6378 km!

Note 5: In table 2, numbers in front of some of the columns in the format of (a%) are the allocated mark associated with that column. For example, column "suburb" carries 15% of the total output mark of task 1. Also, please note that we are aware that the summation of percentages is 90%. The other 10% goes to the issue(s) that may appear during data integration tasks and you should find and resolve them.

Attachment:- Data wrangling.rar

Reference no: EM132796745

Questions Cloud

Should project be implemented if superior manufacturing : Extra inventory for spare parts and accessories. Should this project be implemented if Superior Manufacturing requires an 8 percent rate of return?
What was meant by kill the indian save the man : What was meant by, "kill the Indian, save the man"? After being removed from their "spiritual homeplace", how might this affect American Indian religion?
Calculate the price-earnings ratio after the repurchase : Entire amount of excess cash will be utilized for share repurchase at the current market price. Calculate the price-earnings ratio after the repurchase.
Which is an example of a sunk cost in a long term decision : Which is an example of a sunk cost in a long term decision regarding the replacement of an existing piece of equipment with new equipment?
FIT5196 Data wrangling Assignment : FIT5196 Data wrangling Assignment Help and Solution, Monash University - Assessment Writing Service - write Python code to integrate several datasets
What is the hunger winter : Discuss the concepts presented in the following videos. Did you encounter any new information? Share additional sources and thoughts.
How does parenting style change as a child develops : Review the definitions of parenting styles. The parenting styles consist of: Authoritarian Parenting. What are the characteristics of the ideal parents?
Find how much baltimore company report for investment : Use this information to determine, how much Baltimore Company should report for its investment in Towson Company on December 31, 2018.
How much baltimore company should report for investment : Determine, how much Baltimore Company should report for its investment in Towson Company on December 31, 2018. (Round to the nearest dollar.)

Reviews

len2796745

2/12/2021 11:26:10 PM

I am a masters student at and I need help with my third assignment of DATA WRANGLING. I want to score a good grade because I haven''t been able to score well in the past assignments and therefore I need to score well in this one.

Write a Review

Python Programming Questions & Answers

  Write a python program to implement the diff command

Without using the system() function to call any bash commands, write a python program that will implement a simple version of the diff command.

  Write a program for checking a circle

Write a program for checking a circle program must either print "is a circle: YES" or "is a circle: NO", appropriately.

  Prepare a python program

Prepare a Python program which evaluates how many stuck numbers there are in a range of integers. The range will be input as two command-line arguments.

  Python atm program to enter account number

Write a simple Python ATM program. Ask user to enter their account number, and print their initail balance. (Just make one up). Ask them if they wish to make deposit or withdrawal.

  Python function to calculate two roots

Write a Python function main() to calculate two roots. You must input a,b and c from keyboard, and then print two roots. Suppose the discriminant D= b2-4ac is positive.

  Design program that asks user to enter amount in python

IN Python Design a program that asks the user to enter the amount that he or she has budget in a month. A loop should then prompt the user to enter his or her expenses for the month.

  Write python program which imports three dictionaries

Write a Python program called hours.py which imports three dictionaries, and uses the data in them to calculate how many hours each person has spent in the lab.

  Write python program to create factors of numbers

Write down a python program which takes two numbers and creates the factors of both numbers and displays the greatest common factor.

  Email spam filter

Analyze the emails and predict whether the mail is a spam or not a spam - Create a training file and copy the text of several mails and spams in to it And create a test set identical to the training set but with different examples.

  Improve the readability and structural design of the code

Improve the readability and structural design of the code by improving the function names, variables, and loops, as well as whitespace. Move functions close to related functions or blocks of code related to your organised code.

  Create a simple and responsive gui

Please use primarily PHP or Python to solve the exercise and create a simple and responsive GUI, using HTML, CSS and JavaScript.Do not use a database.

  The program is to print the time

The program is to print the time in seconds that the iterative version takes, the time in seconds that the recursive version takes, and the difference between the times.

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd