- Atabey Kaygun (kaygun@itu.edu.tr)
- Lectures: Fridays 14:00-17:00
Data science is a broad interdisciplinary field. It lies in the intersection of mathematics, statistics, and computer science and use their methods and tools to extract information and insight from data. This course is an introductory level data science course. We are going to introduce different data types (structured and unstructured) from different fields, and focus on importing, cleaning, reshaping, exploring, and visualizing data. The course aims to provide the students with basic knowledge on data science computational tools to interpret data from different disciplines.
-
Zaki, M. J. and Meira, W. Data Mining and Machine Learning: Fundamental Concepts and Algorithms (2nd Ed.) Cambridge University Press, March 2020 ISBN: 978-1108473989. [Available Online]
-
VanderPlas, J. T. Python Data Science Handbook: Essential Tools for working with data. O'Reilly. (2017). [Available Online]
-
Rougier, N. Scientific Visualization: Python + Matplotlib. (2021) [hal-03427242] [Available Online]
- UCI datasets
- Google dataset explorer
- Registry of open datasets on AWS
- Open MRI, MEG, EEG, iEEG, and ECoG data
- NCBI datasets
- Open GIS data
- NASDAQ data
- Kaggle Courses on Python, Pandas, Visualization, Data cleaning, and GIS Data.
I will make all of the course related announcement on İTÜ's course management system NINOVA. I will post the grades on NINOVA as well. So, do check it regularly.
I receive approximately 50 e-mails per day. So, if you need to contact me, use the subject ``MAT381E'' in your e-mails. Spend some time structuring your e-mail with grammatically correct sentences in Turkish or in English. Be polite, direct, and concise. State what you need in the first two sentences. Sign your e-mails with your name and student number. If I can't figure out who you are and what you need within 30 seconds of opening your message, I will delete your e-mail with no response. You are hereby warned.
The course is an applied data analysis class. This means the course requires a degree of proficiency of computational tools from which you are going to be responsible.
- git and GitHub
- Python programming language (version 3.10 or higher)
- Anaconda or Pip package managers
- Jupyter notebook system
- Markdown markup language
Installing and maintaining these systems on your machine is your responsibility. I can't help you if something doesn't work. You will need to figure it out on your own. If you can't install these systems on your machine you may try to use an online service:
Your performance is going to be judged via 4 homework assignments posted on the course github page and one final project that you need to write from scratch. Each homework is 15 points, and the final project is worth 40 points. Your total assessment for the course will be evaluated as follows:
If you miss any 2 of the homeworks, or if your total from homeworks is less than 35% you'll get a VF. If your final is less than 25%, or your total is less than 35% you'll receive an F. Note that the conditions for receiving a VF are both necessary and sufficient, while the conditions for receiving an F are only sufficient. This means you may still get an F with a higher score than 35% depending on the distribution of the scores.
| Assessment | Deadline |
|---|---|
| Github link | Sep 30 |
| Homework 1 | Oct 14 |
| Homework 2 | Nov 4 |
| Final Project Proposal | Nov 18 |
| Homework 3 | Dec 2 |
| Homework 4 | Dec 23 |
| Final Project | Dec 30 |
There is no make-up for the homeworks. If you miss any of the homework deadline because of an emergency, do contact me to make an arrangement as soon as you can.
For the homeworks, you are going to need to open a GitHub account and create a repository for this class. I am going to pull your howeworks and final project from your GitHub repositories at 11:59PM of each deadline date. You must open a private github repository and share it with my hotmail address: atabey_kaygun@hotmail.com. Then send my itu address (kaygun@itu.edu.tr) your name, student number and your private github repository link. Your deadline is September 30, 11:59PM. If you do not follow these instructions, I will deduct upto 15 points from your final grade.
I am going to post the homework assignments on the course github page, you'll need to fill in the answers and post it on your own github account by the deadline.
The final project is worth 40 points and will be evaluated on your final project notebook. You may work with a team, but no larger than 3 students. You must open a separate repository with your team and submit the link via e-mail with the subject ``MATH381E Final Project Link'' by November 18th. In that proposal git repository, put a jupyter notebook with
- The title of the project
- The list of team members (names and student numbers)
- Project summary
The project summary must contain the description of the data set you are going to work with, what you want to do with it, and a clear plan how you are going to accomplish your goals. I will grade your proposals (15 points) and might make adjustments on your data set, your hypothesis and your approach.
At the end of the semester when you submit your final project, I also want a short description of who did what for the final project as a supplement.
Passing someone else's code or text as your own is cheating, or worse yet, theft. Copying code with variable names changed is another lazy form of cheating. Depending on severity of the situation, I may even report you to the university. In short, don't do it.
The following is a tentative schedule of topics I am going to cover. I may go faster or slower depending on the week. I may even add new subjects, or even drop subjects depending on requests and participation.
| Week | Subject |
|---|---|
| Sep 23 | Data Science, Machine Learning, Statistics, Computer Science: Similarities and Differences. |
| Sep 30 | Deadline for GitHub link submission. |
| Crash Course in Python and its Library Ecosystem. | |
| Oct 7 | Structured Data: CSV, JSON, XML and YAML |
| Post HW1 | |
| Oct 14 | Deadline for HW1. |
| Open data sources, data APIs, and data scraping. | |
| Oct 21 | Basic visualizations: simple plots, scatter plots, histograms, heatmaps, bar and pie charts. |
| Oct 28 | Unstructured data I: Image data. |
| Post HW2 | |
| Nov 4 | Deadline for HW2. |
| Working with and visualizing high dimensional data: PCA and LDA. | |
| Nov 11 | Unstructured data II: Text data. |
| Nov 18 | Final Project Proposals Due. |
| More on text data. NLP library eco-system. | |
| Dec 2 | Geospatial data and drawing maps. |
| Post HW3 | |
| Dec 9 | Deadline for HW3. |
| Graphs and networks. Working with network data. | |
| Dec 16 | Working with audio data. |
| Post HW4 | |
| Dec 23 | Deadline for HW4. |
| Special topics | |
| Dec 30 | Final Project Due. |