{"id":793,"date":"2013-12-05T15:51:21","date_gmt":"2013-12-05T13:51:21","guid":{"rendered":"http:\/\/oldblogs.uct.ac.za\/blog\/big-bytes\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research"},"modified":"2015-08-14T11:39:08","modified_gmt":"2015-08-14T09:39:08","slug":"enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research","status":"publish","type":"post","link":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/","title":{"rendered":"Enable FTP service for Galaxy – Web-based platform for Data intensive biomedical research"},"content":{"rendered":"

The Galaxy instance we have running at the University of Cape Town operates on the Novell SLES 11 platform. The SMT repositories do not have ProFTPD, which is the recommended FTP service for Galaxy. Also, there is a lack of documentation to configure the FTP service for MySQL on the Galaxy documentation site. I eventually got it working and plan to highlight the missing documentation.<\/p>\r\n

Problem:<\/strong>\u00a0Galaxy users cannot upload large files via the web browser.<\/p>\r\n

<\/p>\r\n

Proposed Solution:<\/strong>\u00a0Enable the FTP service in Galaxy and have the users upload their files via FTP. The files can then be viewed in the web-based portal. The FTP service will authenticate against the MySQL table \"galaxy_user\". Each user will have their own FTP directory.<\/p>\r\n

<\/p>\r\n

Technical Implementation:<\/strong>\u00a0Firstly, we need to add the repository for ProFTPD and set the repository priority to a value higher than the default, 99. We will set it to 120. Add the following repository with either zypper or yast -http:\/\/download.opensuse.org\/repositories\/server:\/ftp\/SLE_11_SP1\/x86_64\/<\/a><\/p>\r\n

<\/p>\r\n

Installation and Configuration Guidelines:<\/strong><\/p>\r\n

1.\u00a0\u00a0\u00a0\u00a0Install ProFTPD<\/p>\r\n

2.\u00a0\u00a0\u00a0\u00a0Create a modules configuration file to load modules for ProFTPD<\/p>\r\n

3.\u00a0\u00a0\u00a0\u00a0Create a mysql configuration file to contain the SQL lookup and database credentials<\/p>\r\n

4.\u00a0\u00a0\u00a0\u00a0Update ProFTPD configuration.<\/p>\r\n

5.\u00a0 \u00a0\u00a0Enable FTP within Galaxy Web Portal<\/p>\r\n

<\/p>\r\n

1. Install ProFTPD:<\/strong><\/p>\r\n

This is a rather simple and efficient process.<\/p>\r\n

\u201czypper install proftpd proftpd-mysql<\/strong>\u201d<\/p>\r\n

<\/p>\r\n

2. Module configuration file:<\/strong><\/p>\r\n

Create a new document file in \/etc\/proftpd\/conf.d\/modules.conf.<\/p>\r\n

Add the following text to the modules.conf file:<\/p>\r\n

\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 LoadModule mod_sql.c<\/strong><\/p>\r\n

\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 LoadModule mod_sql_mysql.c<\/strong><\/p>\r\n

\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 LoadModule mod_sql_passwd.c<\/strong><\/p>\r\n

<\/p>\r\n

3. MySQL configuration file:<\/strong><\/p>\r\n

Before we create the configuration file we need to create a user within the MySQL which will read the galaxy user table. Granting \u201cSelect\u201d on the table is enough to get going. Its best to create a different user id for access to the galaxy_user table as opposed to the Galaxy DB user which has all permissions on the database. The command is as follows:<\/p>\r\n

\u00a0<\/strong><\/p>\r\n

\u00a0grant select on galaxy.galaxy_user to dbuser@localhost identified by 'dbpasswd';<\/strong><\/p>\r\n

\u00a0<\/strong><\/p>\r\n

Go ahead and create the mysql.conf file and add the following to it.<\/p>\r\n

<Global><\/strong><\/p>\r\n

\u00a0\u00a0 SQLEngine\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 on<\/strong><\/p>\r\n

\u00a0\u00a0 SQLConnectInfo\u00a0\u00a0 galaxy@localhost dbuser dbpasswd<\/strong><\/p>\r\n

\u00a0\u00a0 SQLAuthTypes\u00a0\u00a0\u00a0\u00a0 SHA1<\/strong><\/p>\r\n

\u00a0\u00a0 SQLAuthenticate\u00a0 users<\/strong><\/p>\r\n

\u00a0 \u00a0SQLBackend\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 mysql<\/strong><\/p>\r\n

\u00a0\u00a0 SQLPasswordEncoding\u00a0\u00a0 hex<\/strong><\/p>\r\n

\u00a0\u00a0 SQLPasswordEngine\u00a0\u00a0\u00a0\u00a0 on<\/strong><\/p>\r\n

\u00a0\u00a0 SQLDefaultHomedir\u00a0\u00a0\u00a0\u00a0 \/tmp<\/strong><\/p>\r\n

\u00a0\u00a0 SQLLogFile\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \/var\/log\/proftpd\/SQL.log<\/strong><\/p>\r\n

<\/p>\r\n

# Define a custom query for lookup that returns a passwd-like entry.\u00a0 UID and GID should match your Galaxy user.<\/p>\r\n

SQLUserInfo\u00a0 custom:\/LookupGalaxyUser<\/strong><\/p>\r\n

SQLNamedQuery LookupGalaxyUser SELECT \"email,password,'512','512','\/opt\/galaxy-datasets\/database\/files\/%U','\/bin\/bash' FROM galaxy_user WHERE email='%U'\"<\/strong><\/p>\r\n

<\/Global><\/p>\r\n

<\/p>\r\n

4. Update ProFTPD Configuration: \u00a0<\/strong>\/etc\/proftpd\/proftpd.conf<\/p>\r\n

\u00a0<\/strong><\/p>\r\n

AuthOrder\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 mod_sql.c<\/strong><\/p>\r\n

Include\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \/etc\/proftpd\/conf.d\/*.conf<\/strong><\/p>\r\n

ServerName\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 \"ProFTPD on hostname\"<\/strong><\/p>\r\n

ServerType\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 standalone<\/strong><\/p>\r\n

DefaultServer\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 on<\/strong><\/p>\r\n

AllowOverwrite\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 on<\/strong><\/p>\r\n

AllowStoreRestart\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0 on<\/strong><\/p>\r\n

<\/p>\r\n

These options above may or may not be enabled so ensure they are.<\/p>\r\n

<\/p>\r\n

5. Enable the FTP service in Galaxy Portal:<\/strong><\/p>\r\n

Edit the galaxy-dist\/universe_wsgi.ini\u00a0and make the following adjustments<\/p>\r\n

<\/p>\r\n

# This should point to a directory containing subdirectories matching users'<\/p>\r\n

# email addresses, where Galaxy will look for files.<\/p>\r\n

ftp_upload_dir = galaxy-dist\/database\/files\/<\/strong><\/p>\r\n

<\/p>\r\n

# This should be the hostname of your FTP server, which will be provided to<\/p>\r\n

# users in the help text.<\/p>\r\n

ftp_upload_site = ftp_server_name<\/strong><\/p>\r\n

<\/p>\r\n

Restart services:<\/strong><\/p>\r\n

- Restart Galaxy and ProFTPD<\/p>","protected":false},"excerpt":{"rendered":"

The Galaxy instance we have running at the University of Cape Town operates on the Novell SLES 11 platform. The SMT repositories do not have ProFTPD, which is the recommended FTP service for Galaxy. Also, there is a lack of documentation to configure the FTP service for MySQL on the Galaxy documentation site. I eventually got it working and plan to highlight the missing documentation.<\/p>\n

Problem:<\/strong> Galaxy users cannot upload large files via the web browser.<\/p>\n

 <\/p>\n

Proposed Solution:<\/strong> Enable the FTP service in Galaxy and have the users upload their files via FTP. The files can then be viewed in the web-based portal. The FTP service will authenticate against the MySQL table “galaxy_user”. Each user will have their own FTP directory.<\/p>\n

 <\/p>\n

Technical Implementation:<\/strong> Firstly, we need to add the repository for ProFTPD and set the repository priority to a value higher than the default, 99. We will set it to 120. Add the following repository with either zypper or yast –http:\/\/download.opensuse.org\/repositories\/server:\/ftp\/SLE_11_SP1\/x86_64\/<\/a><\/p>\n

 <\/p>\n

Installation and Configuration Guidelines:<\/strong> <\/p>\n

1.    Install ProFTPD<\/p>\n

2.    Create a modules configuration file to load modules for ProFTPD<\/p>\n

3.    Create a mysql configuration file to contain the SQL lookup and database credentials<\/p>\n

4.    Update ProFTPD configuration.<\/p>\n

5.    Enable FTP within Galaxy Web Portal<\/p>\n

 <\/p>\n

1. Install ProFTPD:<\/strong><\/p>\n

This is a rather simple and efficient process.<\/p>\n

“zypper install proftpd proftpd-mysql<\/strong>”<\/p>\n

 <\/p>\n

2. Module configuration file:<\/strong><\/p>\n

Create a new document file in \/etc\/proftpd\/conf.d\/modules.conf.<\/p>\n

Add the following text to the modules.conf file:<\/p>\n

            LoadModule mod_sql.c<\/strong><\/p>\n

            LoadModule mod_sql_mysql.c<\/strong><\/p>\n

            LoadModule mod_sql_passwd.c<\/strong><\/p>\n

 <\/p>\n

3. MySQL configuration file:<\/strong><\/p>\n

Before we create the configuration file we need to create a user within the MySQL which will read the galaxy user table. Granting “Select” on the table is enough to get going. Its best to create a different user id for access to the galaxy_user table as opposed to the Galaxy DB user which has all permissions on the database. The command is as follows:<\/p>\n

 <\/strong><\/p>\n

 grant select on galaxy.galaxy_user to dbuser@localhost identified by ‘dbpasswd’;<\/strong><\/p>\n

 <\/strong><\/p>\n

Go ahead and create the mysql.conf file and add the following to it.<\/p>\n

<Global><\/strong><\/p>\n

   SQLEngine        on<\/strong><\/p>\n

   SQLConnectInfo   galaxy@localhost dbuser dbpasswd<\/strong><\/p>\n

   SQLAuthTypes     SHA1<\/strong><\/p>\n

   SQLAuthenticate  users<\/strong><\/p>\n

   SQLBackend       mysql<\/strong><\/p>\n

   SQLPasswordEncoding   hex<\/strong><\/p>\n

   SQLPasswordEngine     on<\/strong><\/p>\n

   SQLDefaultHomedir     \/tmp<\/strong><\/p>\n

   SQLLogFile       \/var\/log\/proftpd\/SQL.log<\/strong><\/p>\n

 <\/p>\n

# Define a custom query for lookup that returns a passwd-like entry.  UID and GID should match your Galaxy user.<\/p>\n

SQLUserInfo  custom:\/LookupGalaxyUser<\/strong><\/p>\n

SQLNamedQuery LookupGalaxyUser SELECT “email,password,’512′,’512′,’\/opt\/galaxy-datasets\/database\/files\/%U’,’\/bin\/bash’ FROM galaxy_user WHERE email=’%U'”<\/strong><\/p>\n

<\/Global><\/p>\n

 <\/p>\n

4. Update ProFTPD Configuration:  <\/strong>\/etc\/proftpd\/proftpd.conf<\/strong><\/p>\n

 <\/strong><\/p>\n

AuthOrder               mod_sql.c<\/strong><\/p>\n

Include                 \/etc\/proftpd\/conf.d\/*.conf<\/strong><\/p>\n

ServerName              “ProFTPD on hostname”<\/strong><\/p>\n

ServerType              standalone<\/strong><\/p>\n

DefaultServer           on<\/strong><\/p>\n

AllowOverwrite          on<\/strong><\/p>\n

AllowStoreRestart       on<\/strong><\/p>\n

 <\/p>\n

These options above may or may not be enabled so ensure they are.<\/p>\n

 <\/p>\n

5. Enable the FTP service in Galaxy Portal:<\/strong><\/p>\n

Edit the galaxy-dist\/universe_wsgi.ini and make the following adjustments<\/p>\n

 <\/p>\n

# This should point to a directory containing subdirectories matching users’<\/p>\n

# email addresses, where Galaxy will look for files.<\/p>\n

ftp_upload_dir = galaxy-dist\/database\/files\/<\/strong><\/p>\n

 <\/p>\n

# This should be the hostname of your FTP server, which will be provided to<\/p>\n

# users in the help text.<\/p>\n

ftp_upload_site = ftp_server_name<\/strong><\/p>\n

 <\/p>\n

Restart services:<\/strong><\/p>\n

– Restart Galaxy and ProFTPD<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[4],"tags":[],"yoast_head":"\nEnable FTP service for Galaxy - Web-based platform for Data intensive biomedical research - UCT HPC<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Enable FTP service for Galaxy - Web-based platform for Data intensive biomedical research - UCT HPC\" \/>\n<meta property=\"og:description\" content=\"The Galaxy instance we have running at the University of Cape Town operates on the Novell SLES 11 platform. The SMT repositories do not have ProFTPD, which is the recommended FTP service for Galaxy. Also, there is a lack of documentation to configure the FTP service for MySQL on the Galaxy documentation site. I eventually got it working and plan to highlight the missing documentation.Problem: Galaxy users cannot upload large files via the web browser. Proposed Solution: Enable the FTP service in Galaxy and have the users upload their files via FTP. The files can then be viewed in the web-based portal. The FTP service will authenticate against the MySQL table "galaxy_user". Each user will have their own FTP directory. Technical Implementation: Firstly, we need to add the repository for ProFTPD and set the repository priority to a value higher than the default, 99. We will set it to 120. Add the following repository with either zypper or yast -http:\/\/download.opensuse.org\/repositories\/server:\/ftp\/SLE_11_SP1\/x86_64\/ Installation and Configuration Guidelines: 1.    Install ProFTPD2.    Create a modules configuration file to load modules for ProFTPD3.    Create a mysql configuration file to contain the SQL lookup and database credentials4.    Update ProFTPD configuration.5.    Enable FTP within Galaxy Web Portal 1. Install ProFTPD:This is a rather simple and efficient process.“zypper install proftpd proftpd-mysql” 2. Module configuration file:Create a new document file in \/etc\/proftpd\/conf.d\/modules.conf.Add the following text to the modules.conf file:            LoadModule mod_sql.c            LoadModule mod_sql_mysql.c            LoadModule mod_sql_passwd.c 3. MySQL configuration file:Before we create the configuration file we need to create a user within the MySQL which will read the galaxy user table. Granting “Select” on the table is enough to get going. Its best to create a different user id for access to the galaxy_user table as opposed to the Galaxy DB user which has all permissions on the database. The command is as follows:  grant select on galaxy.galaxy_user to dbuser@localhost identified by 'dbpasswd'; Go ahead and create the mysql.conf file and add the following to it.<Global>   SQLEngine        on   SQLConnectInfo   galaxy@localhost dbuser dbpasswd   SQLAuthTypes     SHA1   SQLAuthenticate  users   SQLBackend       mysql   SQLPasswordEncoding   hex   SQLPasswordEngine     on   SQLDefaultHomedir     \/tmp   SQLLogFile       \/var\/log\/proftpd\/SQL.log # Define a custom query for lookup that returns a passwd-like entry.  UID and GID should match your Galaxy user.SQLUserInfo  custom:\/LookupGalaxyUserSQLNamedQuery LookupGalaxyUser SELECT "email,password,'512','512','\/opt\/galaxy-datasets\/database\/files\/%U','\/bin\/bash' FROM galaxy_user WHERE email='%U'"<\/Global> 4. Update ProFTPD Configuration:  \/etc\/proftpd\/proftpd.conf AuthOrder               mod_sql.cInclude                 \/etc\/proftpd\/conf.d\/*.confServerName              "ProFTPD on hostname"ServerType              standaloneDefaultServer           onAllowOverwrite          onAllowStoreRestart       on These options above may or may not be enabled so ensure they are. 5. Enable the FTP service in Galaxy Portal:Edit the galaxy-dist\/universe_wsgi.ini and make the following adjustments # This should point to a directory containing subdirectories matching users'# email addresses, where Galaxy will look for files.ftp_upload_dir = galaxy-dist\/database\/files\/ # This should be the hostname of your FTP server, which will be provided to# users in the help text.ftp_upload_site = ftp_server_name Restart services:- Restart Galaxy and ProFTPD\" \/>\n<meta property=\"og:url\" content=\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/\" \/>\n<meta property=\"og:site_name\" content=\"UCT HPC\" \/>\n<meta property=\"article:published_time\" content=\"2013-12-05T13:51:21+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-08-14T09:39:08+00:00\" \/>\n<meta name=\"author\" content=\"Timothy Carr\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Timothy Carr\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/\"},\"author\":{\"name\":\"Timothy Carr\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0\"},\"headline\":\"Enable FTP service for Galaxy – Web-based platform for Data intensive biomedical research\",\"datePublished\":\"2013-12-05T13:51:21+00:00\",\"dateModified\":\"2015-08-14T09:39:08+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/\"},\"wordCount\":560,\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"articleSection\":[\"hpc\"],\"inLanguage\":\"en-ZA\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/\",\"name\":\"Enable FTP service for Galaxy - Web-based platform for Data intensive biomedical research - UCT HPC\",\"isPartOf\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\"},\"datePublished\":\"2013-12-05T13:51:21+00:00\",\"dateModified\":\"2015-08-14T09:39:08+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/#breadcrumb\"},\"inLanguage\":\"en-ZA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/ucthpc.uct.ac.za\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Enable FTP service for Galaxy – Web-based platform for Data intensive biomedical research\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#website\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"name\":\"UCT HPC\",\"description\":\"University of Cape Town High Performance Computing\",\"publisher\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-ZA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#organization\",\"name\":\"University of Cape Town High Performance Computing\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"contentUrl\":\"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png\",\"width\":450,\"height\":423,\"caption\":\"University of Cape Town High Performance Computing\"},\"image\":{\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0\",\"name\":\"Timothy Carr\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-ZA\",\"@id\":\"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g\",\"caption\":\"Timothy Carr\"},\"sameAs\":[\"http:\/\/ucthpc.uct.ac.za\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Enable FTP service for Galaxy - Web-based platform for Data intensive biomedical research - UCT HPC","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/","og_locale":"en_US","og_type":"article","og_title":"Enable FTP service for Galaxy - Web-based platform for Data intensive biomedical research - UCT HPC","og_description":"The Galaxy instance we have running at the University of Cape Town operates on the Novell SLES 11 platform. The SMT repositories do not have ProFTPD, which is the recommended FTP service for Galaxy. Also, there is a lack of documentation to configure the FTP service for MySQL on the Galaxy documentation site. I eventually got it working and plan to highlight the missing documentation.Problem: Galaxy users cannot upload large files via the web browser. Proposed Solution: Enable the FTP service in Galaxy and have the users upload their files via FTP. The files can then be viewed in the web-based portal. The FTP service will authenticate against the MySQL table \"galaxy_user\". Each user will have their own FTP directory. Technical Implementation: Firstly, we need to add the repository for ProFTPD and set the repository priority to a value higher than the default, 99. We will set it to 120. Add the following repository with either zypper or yast -http:\/\/download.opensuse.org\/repositories\/server:\/ftp\/SLE_11_SP1\/x86_64\/ Installation and Configuration Guidelines: 1.    Install ProFTPD2.    Create a modules configuration file to load modules for ProFTPD3.    Create a mysql configuration file to contain the SQL lookup and database credentials4.    Update ProFTPD configuration.5.    Enable FTP within Galaxy Web Portal 1. Install ProFTPD:This is a rather simple and efficient process.“zypper install proftpd proftpd-mysql” 2. Module configuration file:Create a new document file in \/etc\/proftpd\/conf.d\/modules.conf.Add the following text to the modules.conf file:            LoadModule mod_sql.c            LoadModule mod_sql_mysql.c            LoadModule mod_sql_passwd.c 3. MySQL configuration file:Before we create the configuration file we need to create a user within the MySQL which will read the galaxy user table. Granting “Select” on the table is enough to get going. Its best to create a different user id for access to the galaxy_user table as opposed to the Galaxy DB user which has all permissions on the database. The command is as follows:  grant select on galaxy.galaxy_user to dbuser@localhost identified by 'dbpasswd'; Go ahead and create the mysql.conf file and add the following to it.<Global>   SQLEngine        on   SQLConnectInfo   galaxy@localhost dbuser dbpasswd   SQLAuthTypes     SHA1   SQLAuthenticate  users   SQLBackend       mysql   SQLPasswordEncoding   hex   SQLPasswordEngine     on   SQLDefaultHomedir     \/tmp   SQLLogFile       \/var\/log\/proftpd\/SQL.log # Define a custom query for lookup that returns a passwd-like entry.  UID and GID should match your Galaxy user.SQLUserInfo  custom:\/LookupGalaxyUserSQLNamedQuery LookupGalaxyUser SELECT \"email,password,'512','512','\/opt\/galaxy-datasets\/database\/files\/%U','\/bin\/bash' FROM galaxy_user WHERE email='%U'\"<\/Global> 4. Update ProFTPD Configuration:  \/etc\/proftpd\/proftpd.conf AuthOrder               mod_sql.cInclude                 \/etc\/proftpd\/conf.d\/*.confServerName              \"ProFTPD on hostname\"ServerType              standaloneDefaultServer           onAllowOverwrite          onAllowStoreRestart       on These options above may or may not be enabled so ensure they are. 5. Enable the FTP service in Galaxy Portal:Edit the galaxy-dist\/universe_wsgi.ini and make the following adjustments # This should point to a directory containing subdirectories matching users'# email addresses, where Galaxy will look for files.ftp_upload_dir = galaxy-dist\/database\/files\/ # This should be the hostname of your FTP server, which will be provided to# users in the help text.ftp_upload_site = ftp_server_name Restart services:- Restart Galaxy and ProFTPD","og_url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/","og_site_name":"UCT HPC","article_published_time":"2013-12-05T13:51:21+00:00","article_modified_time":"2015-08-14T09:39:08+00:00","author":"Timothy Carr","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Timothy Carr","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/#article","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/"},"author":{"name":"Timothy Carr","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0"},"headline":"Enable FTP service for Galaxy – Web-based platform for Data intensive biomedical research","datePublished":"2013-12-05T13:51:21+00:00","dateModified":"2015-08-14T09:39:08+00:00","mainEntityOfPage":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/"},"wordCount":560,"publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"articleSection":["hpc"],"inLanguage":"en-ZA"},{"@type":"WebPage","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/","url":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/","name":"Enable FTP service for Galaxy - Web-based platform for Data intensive biomedical research - UCT HPC","isPartOf":{"@id":"https:\/\/ucthpc.uct.ac.za\/#website"},"datePublished":"2013-12-05T13:51:21+00:00","dateModified":"2015-08-14T09:39:08+00:00","breadcrumb":{"@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/#breadcrumb"},"inLanguage":"en-ZA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/ucthpc.uct.ac.za\/index.php\/2013\/12\/05\/enable-ftp-service-for-galaxy-web-based-platform-for-data-intensive-biomedical-research\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/ucthpc.uct.ac.za\/"},{"@type":"ListItem","position":2,"name":"Enable FTP service for Galaxy – Web-based platform for Data intensive biomedical research"}]},{"@type":"WebSite","@id":"https:\/\/ucthpc.uct.ac.za\/#website","url":"https:\/\/ucthpc.uct.ac.za\/","name":"UCT HPC","description":"University of Cape Town High Performance Computing","publisher":{"@id":"https:\/\/ucthpc.uct.ac.za\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/ucthpc.uct.ac.za\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-ZA"},{"@type":"Organization","@id":"https:\/\/ucthpc.uct.ac.za\/#organization","name":"University of Cape Town High Performance Computing","url":"https:\/\/ucthpc.uct.ac.za\/","logo":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/","url":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","contentUrl":"https:\/\/ucthpc.uct.ac.za\/wp-content\/uploads\/2015\/09\/logocircless.png","width":450,"height":423,"caption":"University of Cape Town High Performance Computing"},"image":{"@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/41f6cd039836d7741f2b82a7b7cfe8d0","name":"Timothy Carr","image":{"@type":"ImageObject","inLanguage":"en-ZA","@id":"https:\/\/ucthpc.uct.ac.za\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/7e94dcf3a408e6ada008042fc29d4b15?s=96&d=mm&r=g","caption":"Timothy Carr"},"sameAs":["http:\/\/ucthpc.uct.ac.za"]}]}},"_links":{"self":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/793"}],"collection":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/comments?post=793"}],"version-history":[{"count":2,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/793\/revisions"}],"predecessor-version":[{"id":2065,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/posts\/793\/revisions\/2065"}],"wp:attachment":[{"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/media?parent=793"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/categories?post=793"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ucthpc.uct.ac.za\/index.php\/wp-json\/wp\/v2\/tags?post=793"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}