DDLSchema = "user_id string, user_first_touch_timestamp long, email string"
usersDF = (spark.read
.option("sep", "\t")
.option("header", True)
.schema(DDLSchema)
.csv(usersCsvPath))
Here is what the above code is Doing:
1. We’re reading the CSV file into a DataFrame.
2. We’re specifying the schema of the DataFrame.
3. We’re specifying the separator as a tab.
4. We’re specifying that the CSV file has a header.
When inplace = True is used, it performs operation on data and nothing is returned. When inplace=False is used, it performs operation on data and returns a new copy of data. Here is what the above code is Doing: 1. Creating a new DataFrame from the original one. 2. Adding a new column to the…
sudo apt update sudo apt install software-properties-common sudo add-apt-repository ppa:deadsnakes/ppa sudo apt install python3.8 python3.8 –version Here is what the above code is Doing: 1. Update the list of available packages and their versions, but it does not install or upgrade any packages. 2. Install the software-properties-common package. This package contains add-apt-repository, a tool that…
import os sequence = ( “git init”, “git add .” ) for i, x in enumerate(sequence): print(“{}. RUNNING: [{}]”.format(i, x)) os.system(x) #short explanation “”” 1) Init sequence 2) Loop through sequence and use `os.system()` to run commands “”” Here is what the above code is Doing: 1. Initialize a sequence of commands 2. Loop through…
sheet = google_client.create(‘A new spreadsheet’) Here is what the above code is Doing: 1. Create a new Google Sheets client. 2. Create a new spreadsheet. 3. Create a new worksheet in the spreadsheet. 4. Add some data to the worksheet. 5. Share the spreadsheet with a user. 6. Get the spreadsheet’s URL. 7. Print the…
# https://github.com/publicMindee/mindee-api-python from mindee import Client mindee_client = Client( invoice_token=”your_invoices_api_token_here”, raise_on_error=True ) parsed_data = mindee_client.parse_invoice(“/path/to/file”) Here is what the above code is Doing: 1. Creating a mindee client with your invoices api token 2. Parsing an invoice from a file
A = [‘dummy’,5,2,6,4,1,3] for j in range(2,len(A)): key = A[j] i=j-1 while i>0 and A[i]>key: A[i+1] = A[i] i = i-1 A[i+1] = key A.pop(0) print A Here is what the above code is Doing: 1. We start with the second element in the list, and we call it the key. 2. We then compare…