read file from s3 python

ByAnurag batra October 16, 2022October 23, 2022

boto3 offers a resource model that makes tasks like iterating through objects easier. Unfortunately, StreamingBody doesn't provide readline or readlines.

s3 = boto3.resource('s3')
bucket = s3.Bucket('test-bucket')
# Iterates through all the objects, doing the pagination for you. Each obj
# is an ObjectSummary, so it doesn't contain the body. You'll need to call
# get to get the whole body.
for obj in bucket.objects.all():
    key = obj.key
    body = obj.get()['Body'].read()

Here is what the above code is Doing:
1. Create an S3 resource.
2. Get a bucket by name.
3. Get a list of objects for that bucket.
4. Iterate over the list of objects.
5. Get an object by key.
6. Read the object’s Body.

Python Examples

python get cos sim

ByAnurag batra July 31, 2022June 30, 2022

from numpy import dot from numpy.linalg import norm cos_sim = dot(a, b)/(norm(a)*norm(b)) Here is what the above code is Doing: 1. dot(a, b) is the dot product of the two vectors. 2. norm(a) is the Euclidean norm, and gives the length of the vector. 3. norm(b) is the Euclidean norm, and gives the length of…

Python Examples

dataframe plot distribution of dates

ByAnurag batra September 24, 2022September 6, 2022

df[“date”] = df[“date”].astype(“datetime64”) df.groupby([df[“date”].dt.year, df[“date”].dt.month]).count().plot(kind=”bar”) Here is what the above code is Doing: 1. We’re grouping the dataframe by year and month. 2. We’re counting the number of rows in each group. 3. We’re plotting the result as a bar chart.

Python Examples

how to encode hexadecimal python

ByAnurag batra August 4, 2022June 30, 2022

>>> import binascii >>> binascii.hexlify(b’Blaah’) b’426c616168′ Here is what the above code is Doing: 1. The first line imports the binascii module. 2. The second line creates a variable named b and assigns it the value of the string ‘Blaah’. 3. The third line calls the hexlify() function from the binascii module and passes it…

Python Examples

densenet python keras

ByAnurag batra June 17, 2022May 20, 2022

>>> # Create a `Sequential` model and add a Dense layer as the first layer. >>> model = tf.keras.models.Sequential() >>> model.add(tf.keras.Input(shape=(16,))) >>> model.add(tf.keras.layers.Dense(32, activation=’relu’)) >>> # Now the model will take as input arrays of shape (None, 16) >>> # and output arrays of shape (None, 32). >>> # Note that after the first layer,…

Python Examples

getting image from path python

ByAnurag batra October 17, 2022September 6, 2022

from PIL import Image import glob image_list = [] for filename in glob.glob(‘yourpath/*.gif’): #assuming gif im=Image.open(filename) image_list.append(im) Here is what the above code is Doing: 1. Importing the Python Imaging Library (PIL) 2. Creating a list to store the images 3. Using a for loop to iterate through the image files 4. Opening each image…

Python Examples

set icon title tkinter

ByAnurag batra May 15, 2022April 14, 2022

# my problme was that, i didnt know that the image format must be .ico # you can convert your images in https://convertico.com/ and then: from tkinter import * root = Tk() root.title(‘this is program title’) # icon root.iconbitmap(‘image_name.ico’) root.mainloop() Here is what the above code is Doing: 1. We’re creating a Tk root widget….

Similar Posts