Access to products

Search and download your datasets!

First visit?

Technical FAQ

YES, you need to be registered before downloading MyOcean product.

Please find below the registration steps:

The registration form can be found in the "USER CORNER" section and in the "SERVICES" section. This registration form is a part of the MyOcean agreement named "Service Level Agreement" (SLA).

Read the MyOcean service commitments and licence

Fill in, sign and click on send button the Service Level Agreement on-line form.

If you have any problems with the on-line SLA, please use this PDF Form.

If you have any problems with the "SEND" button of the SLA (PDF form), save the form and send it by e-mail to servicedesk@myocean.eu.org.

You will receive a Login & password from the Service Desk within a maximum of 2 working days. This means that the SLA is accepted.

You can download your products (see FAQ3)

If you have sent the form and not received any response within 2 working days, please contact servicedesk@myocean.eu.org.

You are registered to use MyOcean when the service desk has given you all necessary login/password information. You can now download any MyOcean products.

In order to browse the web portal catalogue, use a web browser and connect to the MyOcean web site.

FAQ2-IMG1

 

There are three ways to enter the catalogue:

  1. Search for a product selecting an area, a parameter, a time coverage, a product type
  2. OR Access full catalogue online and then refine your search
  3. OR Download the latest MyOcean Catalogue (PDF)

FAQ2-IMG4

Identify your product of interest (with the search mode or by browsing the full catalogue), and add it to your cart.

Note that you can narrow your search using the left column items.

FAQ2-IMG5

 

Click on “DOWNLOAD

FAQ2-IMG6

 

Login with your login/passwd provided by the MyOcean service desk. You are redirected to the chosen product.

FAQ2-IMG8
 

After selecting your dataset and applying dataset filters, click on one of the “DOWNLOAD" button proposed. According to product selected, MyOcean propose different solutions (See FAQ6). Select one.

FAQ2-IMG7

 

You first need to register (see FAQ1).

MyOcean is offering 3 different authenticated Download Mechanisms:

  • Subsetter (HTTP protocol, subset the files)
  • Direct Get File (HTTP protocol, save file as is)
  • Myocean FTP (standard FTP protocol, save file as is)

See FAQ6 for more detail on each Download Mechanisms characteristics.

FAQ3-IMG1

Login with your login/passwd provided by the MyOcean service desk. You are redirected to the chosen product.

 

  • Choose one of the datasets of the product

FAQ3-IMG2

 

  • Define the dataset filters :

1.    Geographical area

2.    Time range

3.    Depth

4.    Variables

5.    Click on “Download” button

FAQ3-IMG3

 

A window offers the 3 different authenticated Download Mechanisms specifying the specifities of each, and the volume of the download via Subsetter and Direct Get File :

FAQ3-IMG4

  • Subsetter

The criteria are taken into account :

  • Geographical area
  • Time range
  • Depth
  • Variables
 
  • Direct Get File

The criteria are taken into account :

  • Time range

  • MyOcean FTP

No criteria taken into account.

FAQ3-IMG8

Select dataset by clicking on dataset name link.

FAQ3-IMG9

 

You can also use your favorite FTP client.

 YES , command lines can be particularly useful:
•    if you want to download MyOcean data regularly and automatically (without having to connect manually to the web portal each time)
•    if you want to download a large amount of data because each downloading command is volume limited


 If you choose the SUBSET or DIRECT download mechanism (see FAQ3) you can build command lines using a python script. It can be launched under different environments:  Windows (possibly through Cygwin), Linux and MacOS. See also FAQ5.


If you choose the MyOcean FTP download mechanism (see FAQ3), you can download products using FTP tools or on-line FTP command. You can also use script with FTP command.

 The MyOcean web portal allows you generating a template command line using the python script for downloading product you are interested in. This command line integrates the extraction parameters. In order to first create your command line, you have to navigate as if you wanted to download the data through the web portal.

After selecting product in catalogue and logged in (as shown in FAQ3), the interface will propose you all the datasets available. Select the required dataset.

FAQ5-IMG1

 

The next page allows you to use selections in your download request, then download the data:

FAQ5-IMG2

 

Click on “View Script” button in order to generate a command line corresponding to your request:

FAQ5-IMG3

The generated command runs under the button :

FAQ5-IMG4

If it is the first time you are using script, you first need to download motu python client and python. Then you need to cut and paste the above command line and change local parameters: your password, the output file name, the output directory, and eventually the proxy parameters if you have to pass a proxy to access internet.

Note: if the dataset has an hourly temporal resolution, you may have to define the temporal parameter in the command line with quotes.

Example : python motu-client.py -u your_login -p your_password -m http://data.ncof.co.uk/mis-gateway-servlet/Motu -s http://purl.org/myocean/ontology/service/database#SST_GLO_SST_L4_NRT_OBSERVATIONS_010_001_a -d METOFFICE-GLO-SST-L4-NRT-OBS-SST -x -179.97500610351562 -X 20 -y 0 -Y 70 -t “2011-06-23 12:00:00” -T “2011-06-23 12:00:00” -v analysed_sst -o your_output_directory -f your_output_file_name

 

  • How to run the command line

If it is the first time you are using download scripts, you need to download and install python, and the client script called “motu-client”.
 

Then you will find python here https://www.python.org/download/releases/.

Please download python 2.7.5.  You will find lastest version of the script “motu-client” here: http://sourceforge.net/projects/cls-motu/files/client/motu-client-python/.

Note that if you use the 2.7.6 version, you may encounter the error Connection reset by peer.

 

  • Running command line on windows

The operating system Microsoft Windows is not the most convenient operating system to run command lines. But it is of course feasible to do so, by using DOS command, or installing Cygwin if you are familiar with unix environment.
 

Click on “Start” => “Accessories” => “Command line”
 

Go in the directory where you saved the motu client script.
cd C:your_current_directory
path_to_your_python_binarypython motu-client-pythonmotu-client.py -u XXX -p XXX -m http://misgw-qo-externe.cls.fr/misgw-qo-servlet/Motu -s http://purl.org/myocean/ontology/service/database#misgw-qo-thr -d LR_MOD -x -180.0 -X 180 -y -89 -Y 90 -t 2011-01-02 -T 2011-01-02 -z 0 -Z 0 -v salin-ity temperature -o . -f test.nc

 

  • Running command line on Linux or MacOS

These operating systems are well adapted to run command line. Just open a terminal, go to the directory where you saved the motu client script and run the command.

  For any questions and further assistance you can contact servicedesk@myocean.eu.org.

MyOcean is offering 3 different authenticated Download Mechanisms:

  • Subsetter (HTTP protocol, subset the files)
  • Direct Get File (HTTP protocol, save file as is)
  • MyOcean FTP (standard FTP protocol, save file as is)

For each product, at least one of the three above download mechanism is offered.

For all of them, the user can authenticate with his MyOcean login and password. For the 2 first ones, the authentication is totally secured (https protocol). All download mechanisms are presented to the user on the MyOcean Web Catalogue of products. The user can also access the download mechanism through a web browser, and through command line.

 

For a given product, how to recognize which Download Mechanism is available?

Once in the cart, click on “DOWNLOAD” link, you will be presented up to 3 Download Mechanisms. They can be one of the following:

  • Subsetter : The “Subsetter” allows you to subset the data, and should be used if you wish to download a small part of the total dataset.
  • Direct Get File: The “Direct Get File” directly transfers the file as stored on the server. It is able to deliver compressed data and should be used if you wish to download larger datasets.
  • MyOcean FTP : The “FTP download” allows to download an entire dataset directly from the FTP server at the supply center.

 

What are the advantages of each Download Mechanism?

SUBSETTER : User can retrieve a subset of gridded datasets through http and https protocol. The main idea is: download exactly what user needs. User can retrieve the needed variable, the geospatial coverage, the temporal coverage. There are two ways to access this service: via GUI (through the web portal), or via a machine to machine interface (script). The advantages of this service are:

User minimizes the volume of data transiting on the network, and the volume of data to be stored on his computer.

User selects the different parameters of his request in a “easy to understand” way: variable can be selected via their names or standard names (from CF convention standard name table), date format is harmonized at MyOcean level (ex: 2013-02-22).

Information on dataset (notably the updated temporal coverage) and on the request (volume of the request), can be provided to user before running the request (via GUI or via script).

Security of the authentication (https, CAS authentication with a ticket).

 

DIRECT GET FILE : User can retrieve data files by selecting a temporal coverage through http and https protocol. There are two ways to access this service: via GUI (through the web portal), or via a machine to machine interface (script). The advantages of this service are:

Download at once the entire geospatial coverage and all variable(s) of dataset.

Select temporal coverage in a “easy to understand” way: date format is harmonized at MyOcean level (ex: 2013-02-22).

Information on dataset (and notably the updated temporal coverage) and on the download request (notably the volume of the request), can be provided to user before running the request (via GUI or via script).

Security of the authentication (https, CAS authentication with ticket).

 

MYOCEAN FTP DOWNLOAD: The user can retrieve data files by selecting files in a directory through FTP protocol. There are three ways to access this service: via a web browser, via an FTP client with GUI (user shall install this client on his computer before), or via a machine to machine interface. The advantages of this service are:

Download at once the entire geospatial coverage and all variable(s) of dataset.

Performances of the server depend only on disk access performances and bandwidth.

FTP protocol is well known among users.

Volume limitations for a single request have been set up on Subset and Direct Download mechanisms in order to guaranty good performances. The maximum amount of data you can download is 1 Gigabyte for a single request. If your single request is beyond this size, an error message will be immediately displayed: "The size of the data to download - ... Megabytes- exceeds the maximum allowed - 1024 Megabytes". You can also encounter a "proxy error 502". This error message appears when a request lasts too long.

FAQ7-IMG1

In order to overcome the limited volume associated to a single request, you need to use multiple requests (i.e.: a loop within a script command line) hence splitting the data volume into smaller pieces at a time. For example in your script command line, you can change the temporal extraction windows.

FTP download does not offer this limitation, however the way of downloading data (no subset / full data download) can generate large volumes of data transfer that has impacts on bandwidth and significantly increase overall download time.

One download request results into one file, so downloading a very large amount of data (i.e. more than 1Gb) with a single request is not allowed. Moreover, it is not recommended to manipulate files larger than 1Gb, for usability purpose.

Downloading a very large amount of data, especially for downloading large time coverage (like 10 days or 20 years) is possible through the MyOcean download service : The simplest way is to perform a loop on dates. You need to split your download requests into several download requests.

For example, below you can find a loop coded in a simple Unix/Linux shell script.
# Definition of the dates
DATES=(2011-01-01 2011-01-02 2011-01-03 2011-01-04 2011-01-05 2011-01-06)

# Loop on the dates
for (( i = 0 ; i < ${#DATES[@]} ; i++ ))
do
      #Download request (should be adapted)
        python motu-client-python/motu-client.py -u XXX -p XXX -m http://misgw-qo-externe.cls.fr/misgw-qo-servlet/Motu -s http://purl.org/myocean/ontology/service/database#misgw-qo-thr -d LR_MOD -x -180.0 -X 180 -y -89 -Y 90 -t ${DATES[$i]} -T ${DATES[$i]} -z 0 -Z 0 -v salinity temperature -o ./ -f test.nc
done

 

The array DATES shall be adapted to each situation (time coverage of the dataset and your own need). Of course, depending on the way you want to code the loop (python, perl, java…), you will have to adapt the code. The line in blue is a command line to download one time step of data.

  • Ocean Colour Product

python motu-client-python/motu-client.py -u XXX -p XXX -m http://myocean.artov.isac.cnr.it/mis-gateway-servlet/Motu -s http://purl.org/myocean/ontology/service/database/OCEANCOLOUR_MED_CHL_L3_REP_OBSERVATIONS_009_073-TDS -d OCEANCOLOUR_MED_CHL_SEAWIFS_L3_RAN_OBSERVATIONS_009_073 -o . -t 2009-12-04 -T 2009-12-04 --out-name test_color.nc

python motu-client-python/motu-client.py -u XXX -p XXX -m http://myocean.acri.fr/mis-gateway-servlet/Motu? -s http://purl.org/myocean/ontology/service/database/OCEANCOLOUR_ARC_OPTICS_L3_NRT_OBSERVATIONS_009_046 -d dataset-oc-arc-opt-modis_a-l3-aph_1km_daily-rt-v01 -o ./ -t 2010-09-03 -T 2010-09-03 -y 0 -Y 68 -x 0 -X 100 -z 0 -Z 50 -v volume_attenuation_coefficient_of_downwelling_radiative_flux_in_sea_water --proxy-server http://proxyURL:port --out-name test_color.nc
 

  • Global analysis and forecast product

python motu-client-python/motu-client.py -u XXX -p XXX -m http://atoll.mercator-ocean.fr/mfcglo-mercator-gateway-servlet/Motu? -s http://purl.org/myocean/ontology/service/database#GLOBAL_ANALYSIS_FORECAST_PHYS_001_002-TDS -d global-analysis-forecast-phys-001-002  -o ./ -t 2013-01-21 -T 2013-01-22 -y 0 -Y 68 -x 0 -X 100 -z 0 -Z 50 -v sea_water_salinity --proxy-server http://proxyURL:port --out-name test_mercator.nc

python motu-client-python/motu-client.py -u XXX -p XXX -m http://atoll.cls.fr/mfcglo-armor-gateway-servlet/Motu? -s http://purl.org/myocean/ontology/service/database#GLOBAL_REANALYSIS_PHYS_001_003_b-TDS -d dataset-armor-3d-ran-v1-myocean -o ./ -t 2009-11-20 -T 2009-11-22 -y -80 -Y 80 -x -180 -X 180 -z 0 -Z 0 -v sea_water_salinity --proxy-server http://proxyURL:port --out-name test_armor.nc
 

  • Mediterranean Sea product

An example of shell script with a loop:

DATES=(2005-01-01 2005-01-02) #etc...
# Loop on the dates
for (( i = 0 ; i < ${#DATES[@]} ; i++ ))
 do

       #Download request
       python motu-client-python/motu-client.py -u XXX -p XXX -m

       http://gnoodap.bo.ingv.it:4080/mis-gateway-servlet/Motu? -s

        http://purl.org/myocean/ontology/service/database#MEDSEA_ANALYSIS_FORECAST_PHYS_006_001_a-TDS -d myov01-med-ingv-sal-analysis -o ./ -z 1.47 -Z 7.95 -t ${DATES[$i]} -T ${DATES[$i]} --out-name ingv_analysis_sal_${DATES[$i]}.nc

done
 

  • Sea Level product

Please note that concerning the Sea Level products, you receive a zip file containing some netCDF files, and not the netCDF file directly.

python motu-client-python/motu-client.py -u XXX –p XXX -m http://atoll.cls.fr/sltac-gateway-servlet/Motu? -s http://purl.org/myocean/ontology/service/database#cls-toulouse-fr-sltac-motu-rest -d http://purl.org/myocean/ontology/product/database#dataset-duacs-nrt-global-j1-sla-l3 -o ./ -t 2010-11-02 -T 2011-10-03 --proxy-server http://proxyURL:port --out-name test_sltac.zip

NO

With your login/password delivered by Service Desk when you first registered, you can access all products from the online catalogue of products. However, few products might remain unavailable, in which case you need to contact the service desk by email.
 

This might be due to your computers security settings: the direct download service requires you to accept cookies from a third party website (https://coremis-cas.myocean.eu/cas/login). 

The easiest way to enable this is to access your browsers security settings and select ‘accept third party cookies’.

Note that the default security settings do not allow downloading from third party cookies, which is needed to access MyOcean data through the web portal. In this situation a small icon appears on the status bar to inform the user that a cookie has been rejected.

Decreasing the security settings will prevent this issue. Hence we recommend:

1. Select ‘Tools’ from the top menu bar

2. Select ‘Internet Options

3. Select the ‘Security’ tab

4. Move the slider all the way down to ‘accept all cookies’.

 

In some cases this may not be possible, for example if internet security settings are centrally controlled. 

Please be aware that the MyOcean team is working on better solutions for this issue.

The MyOcean Web Portal shows a bug for Internet Explorer with version lower to 7, which makes it impossible to see the web catalogue, and that has nothing to do with cookies. Note that MyOcean WebPortal is only compatible with Internet Explorer version 7 or higher.

Please accept our apologies and be aware that the MyOcean team is working on this issue.

We recommend accessing the MyOcean WebPortal using other browsers than Internet Explorer (Such as Mozilla Firefox or Google Chrome).

  • A- DEFINITION: what is Netcdf?

http://www.unidata.ucar.edu/software/netcdf/

With a list of Software for Manipulating or Displaying NetCDF Data : http://www.unidata.ucar.edu/software/netcdf/software.html

 

  • B- UNCOMPRESS

(non exhaustive list)

Bzip2 decompressor (windows: http://www.7-zip.org/) or Bzip2 project pages at http://www.bzip.org/

 

  • C- VIEW

(non exhaustive list of visualization tools, i.e. easy to install)

Ncview (http://meteora.ucsd.edu/~pierce/ncview_home_page.html) : Simple visualization and analysis (easy to install on unix/linux platforms, possible on windows)

Ferret (http://ferret.wrc.noaa.gov/Ferret/) Advanced visualization and analysis (you need to develop your own program)

Matplotlib, python library (http://matplotlib.sourceforge.net/)

ncl        : http://www.ncl.ucar.edu

idv        : http://www.unidata.ucar.edu/software/idv (Advanced view with 3D animation)

 

  • D- EXTRACT/MANIPULATE (Concatenation/Computing the mean/Add variable and attributs ....)

(non exhaustive list)

List of the NetCDF software packages, http://www.unidata.ucar.edu/software/netcdf/software.html

NetCDF software package, including libraries for programming languages such as Fortran and C++, can be freely downloaded, please see: http://www.unidata.ucar.edu/software/netcdf/docs/faq.html#howtoget. This package is the best way for performing detailed processing of NetCDF files, including conversion to ASCII or other file formats.

 

A powerful set of tools (for Extraction/Concatenation/Computing the mean/Add variable and attributes) for working with NetCDF files are the NetCDF operators (NCO), which can be freely obtained from http://nco.sourceforge.net/

cdo: https://code.zmaw.de/projects/cdo

Marine Geospatial Ecology Tools (http://code.env.duke.edu/projects/mget), a free add-on to ArcGIS, that allows converting formats such as NetCDF to ASCII and ArcGrid.

 

  • E- CONVERT (from Netcdf to GRIB for example)

ncl: http://www.ncl.ucar.edu

complete historical validation statistics system for the near-real-time MyOcean2 products is accessible from the MyOcean2 webportal.

The statistics are computed as part of the operational systems within each production centre and are monitored by scientists to check the performance of the systems.
 
Users are in a position to access statistics, along with notes which describes how the statistics are calculated and explain any unusual behaviour in the values.

To access to these statistics, please visit the Validation Statistics page.

  FAQ14-IMG1

These statistics are complementary to the product quality documentation (QuID) accessible through the catalog, in each product documentation page.

Most MyOcean products have a Quality Information Document (QuID).

The QuID and the Product User Manual are both accessible on the Catalogue Product Page after the selection (by clicking on  "MORE INFO " and then on "DOCUMENTATION").

 

Each product in the online catalogue of products has its own individual URL that allow a direct access to a product sheet. This allow you to target directly the needed product when browsing through the catalogue, save this address for further reference or send it to somebody else.

FAQ15-IMG1

In less than ten seconds, you can quickly visualize a product using the on-line Viewer.

We illustrate here the viewing for BLACKSEA-ANALYSIS-FORECAST-PHYS-007-001 product.

On the Web Portal, search the BLACKSEA-ANALYSIS-FORECAST-PHYS-007-001 product in the catalogue, then add it to your cart, or display the information product page.

FAQ16-IMG1

 

Then, in your cart or in the information page, click on the "VIEW" link to start the product VIEWER.

FAQ16-IMG2

 

The Viewer interface allows you to:

  • Zoom on the map by double clicking.
  • Move on the map center by holding down the left mouse button and moving the mouse.
  • Update the map color and opacity using the right color bar buttons
  • Change the parameter, the date and the depth level by using the top-level buttons.

​You will find more information about the Viewing in the MyOcean Viewer User Guide.

 

You can get real-time information on the production events which can have an impact on your activities (product availability issues, quality issues, services issues) on the web portal, on the News Flash pages.

On the web portal, in the Short-Cut to Services, select the All News Flash link. You are redirected to the News/Flash information. Information is provided on the form of a historical table summarizing all events with the recording date, the subject and the status.

FAQ17-IMG1

 

You can search information by selecting “Area”, “Parameters” and “Type” criterions on the table header.

FAQ17-IMG2

 

You can get detailed information for each event by clicking on the subject.

FAQ17-IMG3

 

You can also subscribe to RSS feeds by clicking on the RSS link. It will allow you to visualize all event information from your web browser.

FAQ17-IMG4

 

FAQ17-IMG5

 

You can also get event information by email by asking the Service Desk by email.

You can find more information on products on-line with downloading Product User Manual and Quality Manual documents.

On the Web Portal, access the Catalogue and select your product of interest.

FAQ18-IMG1

 

You get the product information summary pages. To get more information on the product, select the MORE INFO button.

FAQ18-IMG2

 

The Product User Manuals and Quality Information Documents:

Documentation on products, i.e. Product User Manual and Quality Documents (PUM and QUID) are available by clicking on 'Documentation' tab in the on-line product info page.

FAQ18-IMG3

 

FAQ18-IMG4        FAQ18-IMG5