Skip to content

Latest commit

 

History

History
142 lines (88 loc) · 10.3 KB

README.md

File metadata and controls

142 lines (88 loc) · 10.3 KB

MCExtractor

Intel, AMD, VIA & Freescale Microcode Extraction Tool

MC Extractor News Feed

MC Extractor Discussion Topic

Intel, AMD, VIA & Freescale CPU Microcode Repositories

A. About MC Extractor

MC Extractor is a tool which parses Intel, AMD, VIA and Freescale processor microcode binaries. It can be used by end-users who are looking for all relevant microcode information such as CPUID, Platform, Version, Date, Release, Size, Checksum etc. It is capable of converting Intel microcode containers (dat, inc, h, txt) to binary images for BIOS integration, detecting new/unknown microcodes, checking microcode health, Updated/Outdated status and more. MC Extractor can be also used as a research analysis tool with multiple structures which allow, among others, full parsing & information display of all documented or not microcode Headers. Moreover, with the help of its extensive database, MC Extractor is capable of uniquely categorizing all supported microcodes as well as check for any microcodes which have not been stored at the Microcode Repositories yet.

A1. MC Extractor Features

  • Supports all current & legacy Microcodes from 1995 and onward
  • Scans for all Intel, AMD, VIA & Freescale microcodes in one run
  • Verifies all extracted microcode integrity via Checksums
  • Checks if all Intel, AMD & VIA microcodes are Latest or Outdated
  • Searches on demand for all microcodes based on CPUID
  • Shows microcode Header structures and details on demand
  • Ignores most false positives based on sanity checks
  • Supports known special, fixed or modded microcodes
  • Ability to automatically extract Intel Extended microcodes
  • Ability to automatically extract Intel Containers (dat,inc,txt,h)
  • Ability to quickly add new microcode entries to the database
  • Ability to detect Intel Production/Pre-Production Release tag
  • Ability to check for MC Extractor and/or DB updates on demand
  • Ability to analyze multiple files by drag & drop or by input path
  • Ability to ignore extracted duplicates based on name and contents
  • Ability to automatically scan for newer MC Extractor & Database releases
  • Reports all microcodes which are not found at the Microcode Repositories
  • Features command line parameters to enhance functionality & assist research
  • Features user friendly messages & proper handling of unexpected code errors
  • Shows results in nice tables with colored text to signify emphasis
  • Open Source project under permissive license, comment assisted code

A2. Microcode Repository Database

MC Extractor allows end-users and/or researchers to quickly extract, view, convert & report new microcode versions without the use of special tools or Hex Editors. To do that effectively, a database had to be built. The Intel, AMD, VIA & Freescale CPU Microcode Repositories is a collection of every Latest Production Intel, AMD & VIA CPU Microcodes we have found. Its existence is very important for MC Extractor as it allows us to continue doing research, find new types of microcode, compare releases for similarities, check for updated binaries etc. Bundled with MC Extractor is a file called MCE.db which is required for the program to run. It includes entries for all Microcode binaries that are available to us. This accommodates primarily two actions: a) Check whether the imported microcode is up to date and b) Help find new Microcode releases sooner by reporting them at the Intel, AMD, VIA & Freescale CPU Microcode Repositories Discussion thread.

A3. Sources and Inspiration

MC Extractor was initially based on a fraction of Lordkag's UEFIStrip tool so, first and foremost, I thank him for all his work which inspired this project. Among others, great places to learn about microcodes are Intel's own download site and official documentation, Intel Microcode Patch Authentication, Coreboot (a,b,c), Microparse by Dominic Chen, Ben Hawkes's Notes and Research, Richard A Burton's Microdecode, AIDA64 CPUID dumps, Sandpile CPUID, Free Electrons (a, b), Freescale (a, b, c, d) and many more which I may have forgotten but would have been here otherwise.

B. How to use MC Extractor

There are two ways to use MC Extractor, MCE script & command prompt. The MCE script allows you to input or drag & drop one or more firmware and view them one by one or recursively scan entire directories. To manually use MC Extractor, a command prompt can be used with -skip as parameter.

B1. MC Extractor Script

To use MC Extractor, select one or multiple files and input or Drag & Drop them to its script. You can also input certain optional parameters either by running MCE directly or by first dropping one or more files to it. Keep in mind that, due to operating system limitations, there is a limit on how many files can be dropped at once. If the latter is a problem, you can always use the -mass parameter to recursively scan entire directories, as explained below.

B2. MC Extractor Parameters

There are various parameters which enhance or modify the default behavior of MC Extractor:

  • -? : Displays help & usage screen
  • -skip : Skips welcome & options screen
  • -exit : Skips Press enter to exit prompt
  • -mass : Scans all files of a given directory
  • -info : Displays microcode structure info
  • -add : Adds input microcode to DB, if new
  • -dbn : Renames input file based on unique DB name
  • -duc : Disables automatic check for MCE & DB updates
  • -search : Searches for microcodes based on CPUID/Model
  • -last : Shows "Last" status based on user input
  • -repo : Builds microcode repositories from input
  • -blob : Builds a Microcode Blob (MCB) from input

B3. MC Extractor Microcode Blob (MCB)

MC Extractor can build its own Microcode Blob (MCB) format, which combines multiple Intel or AMD microcode binaries into one file. This mainly allows quick & automatic extraction of the latest compatible microcode binary based on the equivalent user microcode binary input. The MCB consists of an identifiable Header and an Entry Look Up Table (LUT) followed by the actual Microcode binary data. The Header includes info such as Microcode Vendor (Intel or AMD), Number of Microcodes, MCE DB Revision and a Checksum which covers the entire blob. The LUT entries include details for each microcode binary such as CPUID, Platform, Revision, Date, Size, Checksum and blob Offset.

To build a MCE Microcode Blob (MCB.bin), input the desired Intel or AMD microcode binaries and use -blob parameter. You can use your own microcodes or find the Latest Production Intel and AMD ones at the Intel, AMD, VIA & Freescale CPU Microcodes repository. To extract the latest microcode from a MCB, input a single microcode binary and use -blob -search parameters. MC Extractor will validate the detected MCB, check if the microcode is already up-to-date before extracting the latest and notify accordingly.

B4. MC Extractor Flow Control

During operation, MC Extractor may encounter issues that can trigger Notes, Warnings and/or Errors. Notes (yellow/green color) provide useful information about a characteristic of this particular firmware. Warnings (purple color) notify the user of possible problems that can cause system instability. Errors (red color) are shown when something unexpected or problematic is encountered.

C. Download MC Extractor

MC Extractor consists of two files, the script (MCE.py) and its database (MCE.db). Download the latest version from the Releases tab, title should start with "MC Extractor vX.Y.Z". You may need to scroll down a bit if there are DB releases at the top. The latter can be used to update the outdated DB which was bundled with the latest "MC Extractor vX.Y.Z" release, title should start with "DB rXY".

C1. Compatibility

MC Extractor should work at all Windows, Linux or macOS operating systems which have Python >= 3.7 support.

C2. Prerequisites

To run MC Extractor, you need to install Python >= 3.7, followed by these 3rd party Python modules:

pip3 install colorama pltable

D. Pictures

Note: Some pictures may be outdated and depict older MC Extractor versions.