User-agent: *
Allow: /commodities
Allow: /industries
Allow: /indicators
Allow: /tradeSummary
Allow: /trade
Allow: /eurostat
Disallow: /search
Crawl-delay: 1
Clean-param: ag2&classification&commodity&country&device&domain&filename&filter_code&filter_request_type&filter_template_type&filter_text&indicator&limit_offset&limit_rows_count&link_follow_type&linkedsection&load_table_data&locale&mobile&page&parametername&parent&partner&partnerrank&period&reporter&requesturi&search_section&search_text&section&selected_ids&sort_column_index&sort_column_type&tradeflow&imf_weo_geo&imf_weo_subject&imf_weo_version
Host: data.trendeconomy.com