Archive of FeedHenry Developer Blog 2012-2016

Web Scraping for Fun & Profit II

In my Web Scraping blog post, I described some simple ways to retrieve data from a web page using Node.js. This means of data retrieval proves useful when no API is available. Today, I’m going to describe similar techniques where reverse engineering & more complex authentication flows are involved to retrieve data. Authentication When we need to authenticate before viewing the data we need to scrape, the complexity increases significantly. There’s many different types of authentication - the vast majority of which we can tackle in Node.js.

The FeedHenry & Red Hat Devoxx Keynote Demo Team explains it all

It was a real pleasure to see how well the Red Hat keynote at Devoxx went in Antwerp recently. We don’t have a video of that yet, but Markus Eisele got the band back together for an encore on Google Hangouts last week. The guys explain all of the tech behind the demo and show how FeedHenry, JBoss Fuse, xPaaS on OpenShift, and AeroGear/Unified Push worked beautifully together to deliver a fun demo.

A walkthrough of our new Teams & Collaboration functionality

Today we announced our new Teams & Collaboration feature-set which enables both technical and non-technical teams to work together on complex enterprise mobility projects in both a collaborative and controlled way. FeedHenry 3 projects often have native Android and iOS teams, a Hybrid team, a web-app team, a Node.js team and Enterprise connector teams before you even consider outsourcers, configuration managers and data processors. Teams & Collaboration is built on several simple but powerful concepts so that complex teams, organisations and projects such as these can be setup.

FeedHenry and Red Hat Pushing ahead with Integrations

Overview It’s been only 4 weeks since Red Hat acquired FeedHenry and we are delighted to be able to already announce the immediate availability of the first FeedHenry MBaaS Service for integrating with the Red Hat product suite. AeroGear - Red Hat’s open source offering for Unified Push Notification - can now be seamlessly accessed and leveraged as a microservice from the FeedHenry MBaaS Service Catalog. The driver for this integration is the upcoming Devoxx conference, where we will be showcasing the FeedHenry Mobile application Platform integrating with a range of Red Hat products and service in a fun and interactive demo as part of Wednesday’s Keynote.

Using fh.db in your apps.

Introduction. MongoDb is the leading NoSQL database available at the moment and the FeedHenry platform provides access to this hosted storage via the standard MongoDb driver or via the FeedHenry fh.db API. Details of this API can be found in the Docs section of your development studio but, for now, here is an example of how fh.db can be used in your app to host a database that can be accessed by multiple apps.

Publishing the gitlab-shell Java client to the Maven Central Repository

What library is being published, and why? The library being published to maven is a java client for interacting remotely with gitlab-shell https://github.com/gitlabhq/gitlab-shell. It uses the Jsch libary to remotely connect (SSH) to the machine with gitlab-shell installed, and execute gitlab-shell administration commands. The reason for creating this library is because one did not exist already. There are many different gitlab client libraries, but none for interacting directly with gitlab-shell, the underlying git repository service for gitlab.

Creating & Publishing a Chef Cookbook for gitlab-shell

What was done and why? This article details the steps that were followed to: Create a new chef cookbook (for installing gitlab-shell) Write a recipe, with a set of configurable attributes Deploy/Publish this cookbook to the ‘Chef Supermarket’ Include the newly published cookbook in chef based project The main reason for doing this was because a cookbook for installing just gitlab-shell did not exist (More than 1 for a full gitlab installation did) Creating the cookbook The knife command is the main cli tool for doing chef stuff.

Web Scraping for Fun & Profit

There’s a number of ways to retrieve data from a backend system within mobile projects. In an ideal world, everything would have a RESTful JSON API - but often, this isn’t the case.Sometimes, SOAP is the language of the backend. Sometimes, it’s some proprietary protocol which might not even be HTTP-based. Then, there’s scraping. Retrieving information from web sites as a human is easy. The page communicates information using stylistic elements like headings, tables and lists - this is the communication protocol of the web.