跳到主要内容

Reading and Writing Files

Interacting with files is a fundamental aspect of programming, especially in automation and data processing tasks. Python provides robust capabilities to manipulate files and directories, making it a powerful tool for IT specialists and system administrators.

File Systems Overview​

Operating systems like Windows, macOS, and Linux use file systems to organize data storage and access. Data is stored in files within containers called directories or folders. These are structured hierarchically in a tree format.

Paths in File Systems​

  • Absolute Path: Specifies the complete path to a file or directory from the root of the file system.
    • Windows Example: C:\Users\Jordan
    • Linux Example: /home/jordan
  • Relative Path: Specifies a path relative to the current working directory.
    • Example: If the current directory is /home/jordan, the relative path examples refers to /home/jordan/examples.

Understanding paths is crucial when writing scripts that interact with the file system, as it determines how resources are located and accessed.

Reading Files​

Python allows you to read files using built-in functions and methods, enabling efficient data processing.

Opening Files​

Use the open() function to open a file and create a file object:

file = open("spider.txt")
  • By default, files are opened in read-only mode ("r").
  • The open() function checks for the file's existence and permissions.

Reading Methods​

readline()​

Reads a single line from the file:

print(file.readline())
print(file.readline())

read()​

Reads the entire file from the current position to the end:

print(file.read())

Iterating Over Files​

You can iterate over each line in the file:

with open("spider.txt") as file:
    for line in file:
        print(line)

Handling Newlines​

Lines read from a file include the newline character (\n):

  • This can cause extra blank lines when printing.

  • Use strip() to remove surrounding whitespace:

    with open("spider.txt") as file:
        for line in file:
            print(line.strip())

Closing Files​

Always close files to free up resources:

file.close()

  • Using a with statement ensures the file is automatically closed:

    with open("spider.txt") as file:
        # File operations

Iterating Through Files​

Processing files line by line is essential for handling large datasets efficiently.

Reading Lines into a List​

Use readlines() to read all lines into a list:

with open("spider.txt") as file:
    lines = file.readlines()

  • You can then manipulate the list, such as sorting:

    lines.sort()
    print(lines)

Caution with Large Files​

  • Memory Usage: Reading an entire file into memory can be inefficient for large files.
  • Best Practice: Iterate over the file object to read one line at a time.

Escape Characters​

Special characters in strings are represented using escape sequences:

  • Newline: \n
  • Tab: \t
  • Quotes: \' or \"

Example:

print("First Line\nSecond Line")

Writing Files​

Writing to files is crucial for tasks like logging, data output, and report generation.

Opening Files for Writing​

Use open() with the appropriate mode:

  • Write Mode ("w"): Overwrites the file if it exists or creates a new one.

    with open("novel.txt", "w") as file:
        file.write("It was a dark and stormy night.")

  • Append Mode ("a"): Appends to the end of the file.

    with open("log.txt", "a") as file:
        file.write("New log entry\n")

File Modes​

ModeDescription
"r"Read (default). File must exist.
"w"Write. Overwrites existing file or creates new one.
"a"Append. Adds to the end of the file.
"r+"Read and write. File must exist.
"x"Exclusive creation. Fails if file exists.

Overwriting vs. Appending​

  • Overwriting: Using "w" mode replaces the entire content.
  • Appending: Using "a" mode adds content without altering existing data.

Checking File Existence​

Prevent accidental data loss by checking if a file exists:

import os

if os.path.exists("novel.txt"):
    print("File already exists!")
else:
    with open("novel.txt", "w") as file:
        file.write("It was a dark and stormy night.")

Return Value of write()​

The write() method returns the number of characters written:

num_chars = file.write("Hello, World!")
print(num_chars)  # Outputs: 13

File Encoding​

Specify the encoding when working with text files to ensure correct data interpretation.

Text vs. Binary Modes​

  • Text Mode ("t"): Default mode for reading and writing strings.
  • Binary Mode ("b"): For reading and writing bytes objects.

Specifying Encoding​

Use the encoding parameter:

with open("data.txt", "r", encoding="utf-8") as file:
    content = file.read()
  • UTF-8 is standard for text files.

Best Practices in File Handling​

  • Use with Statements: Automatically handles file closing.
  • Handle Exceptions: Use try-except blocks for error handling.
  • Be Mindful of File Modes: Choose the correct mode to prevent data loss.
  • Process Large Files Efficiently: Read large files line by line.
  • Check File Paths: Ensure correct paths, especially when using relative paths.
  • Manage Permissions: Ensure your script has the necessary permissions.

Summary​

Mastering file operations in Python enhances your ability to automate tasks and handle data efficiently.

Key Takeaways:

  • Opening Files: Use open() with the correct mode and encoding.
  • Reading Files: Utilize read(), readline(), and iterate over file objects.
  • Writing Files: Be cautious with file modes to avoid unintentional data loss.
  • File Modes: Understand the differences between "r", "w", "a", and others.
  • Paths: Distinguish between absolute and relative paths.
  • Encoding: Specify encoding to handle text files properly.