• Earn real money by being active: Hello Guest, earn real money by simply being active on the forum — post quality content, get reactions, and help the community. Once you reach the minimum credit amount, you’ll be able to withdraw your balance directly. Learn how it works.

Reverse Engineering MitmProxy2Swagger - Automagically reverse-engineer REST API

Status
Not open for further replies.

0x1

LeVeL23 HacKerS TeaM
User
Joined
Nov 15, 2013
Messages
880
Reputation
0
Reaction score
6,315
Points
243
Credits
78
‎11 Years of Service‎
18%
MitmProxy2Swagger - Automagically reverse-engineer REST API

mitmproxy2swagger.png

 ​

A tool for automatically converting
This link is hidden for visitors. Please Log in or register now.
captures to
This link is hidden for visitors. Please Log in or register now.
specifications. This means that you can automatically reverse-engineer REST APIs by just running the apps and capturing the traffic.






Installation

First you will need python3 and pip3.

Code:
pip install mitmproxy2swagger# ... or ...pip3 install mitmproxy2swagger
Then clone the repo and run mitmproxy2swagger as per examples below.

Usage

Mitmproxy

To create a specification by inspecting HTTP traffic you will need to:

  1. Capture the traffic by using the mitmproxy tool. I personally recommend using mitmweb, which is a web interface built-in to mitmproxy.


    $ mitmweb
    Web server listening at http://127.0.0.1:8081/
    Proxy server listening at http://*:9999
    ...



    IMPORTANT

    To configure your client to use the proxy exposed by mitm proxy, please consult the
    This link is hidden for visitors. Please Log in or register now.
    for more information.
  2. Save the traffic to a flow file.

    In mitmweb you can do this by using the “File” menu and selecting “Save”:

mitmweb_save.png


  1. Run the first pass of mitmproxy2swagger:


    mitmproxy2swagger -i <path_to_mitmptoxy_flow> -o <path_to_output_schema> -p <api_prefix>



    Please note that you can use an existing schema, in which case the existing schema will be extended with the new data. You can also run it a few times with different flow captures, the captured data will be safely merged.

    <api_prefix> is the base url of the API you wish to reverse-engineer. You will need to obtain it by observing the requests being made in mitmproxy.

    For example if an app has made requests like these:


    https://api.example.com/v1/login
    https://api.example.com/v1/users/2
    https://api.example.com/v1/users/2/profile



    The likely prefix is https://api.example.com/v1.
  2. Running the first pass should have created a section in the schema file like this:


    x-path-templates:
    # Remove the ignore: prefix to generate an endpoint with its URL
    # Lines that are closer to the top take precedence, the matching is greedy
    - ignore:/addresses
    - ignore:/basket
    - ignore:/basket/add
    - ignore:/basket/checkouts
    - ignore:/basket/coupons/attach/{id}
    - ignore:/basket/coupons/attach/104754



    You should edit the schema file with a text editor and remove the ignore: prefix from the paths you wish to be generated. You can also adjust the parameters appearing in the paths.
  3. Run the second pass of mitmproxy2swagger:


    mitmproxy2swagger -i <path_to_mitmptoxy_flow> -o <path_to_output_schema> -p <api_prefix> [--examples



    Run the command a second time (with the same schema file). It will pick up the edited lines and generate endpoint descriptions.

    Please note that mitmproxy2swagger will not overwrite existing endpoint descriptions, if you want to overwrite them, you can delete them before running the second pass.

    Passing --examples will add example data to requests and responses. Take caution when using this option, as it may add sensitive data (tokens, passwords, personal information etc.) to the schema.

HAR

  1. Capture and export the traffic from the browser DevTools.

    In the browser DevTools, go to the Network tab and click the “Export HAR” button.

export_har_button.png


  1. Continue the same way you would do with the mitmproxy dump. mitmproxy2swagger will automatically detect the HAR file and process it.



Download && Source

To see this hidden content, you must like this content.
 
Last edited by a moderator:
Status
Not open for further replies.
Back
Top