openstf/stf repository overview

⁠Warning

⁠This project along with other ones in OpenSTF⁠ organisation is provided as is for community, without active development.

⁠You can check any other forks that may be actively developed and offer new/different features here⁠.

⁠Active development has been moved to DeviceFarmer⁠ organisation. Version 3.4.2 is the last release of OpenSTF on DockerHub and 3.4.1 on npmjs.

STF (or Smartphone Test Farm) is a web application for debugging smartphones, smartwatches and other gadgets remotely, from the comfort of your browser.

STF was originally developed at CyberAgent⁠ to control a growing collection of more than 160 devices. As of July 2016 development is mainly sponsored by HeadSpin⁠ and other individual contributors⁠.

We welcome financial contributions in full transparency on our open collective⁠.

⁠Credits

⁠Sponsors

Thank you to all our sponsors! (please ask your company to also support this open source project by becoming a sponsor⁠)

⁠Gold Sponsor

HeadSpin offers a generous monthly contribution towards STF development.

⁠Contributors

Thank you to all the people who have already contributed to STF!

⁠Backers

Thank you to all our backers! [Become a backer⁠]

⁠How to become a sponsor

Please use our open collective⁠ or [contact us][contact-link] directly for sponsor arrangements. Both recurring and one-time contributions are most welcome. Contributions towards a specific issue or feature are also possible, and can be attributed to your company in our release notes and other related materials. Hardware-only contributions, whether new or used, are also extremely helpful and well received, especially if you find a device that doesn't work. Please see our donation transparency report⁠ for past hardware contributions.

⁠Features

• OS support
  • Android
    • Supports versions 2.3.3 (SDK level 10) to 9.0 (SDK level 28)
    • Supports Wear 5.1 (but not 5.0 due to missing permissions)
    • Supports Fire OS, CyanogenMod, and other heavily Android based distributions
    • root is not required for any current functionality
• Remote control any device from your browser
  • Real-time screen view
    • Refresh speed can reach 30-40 FPS depending on specs and Android version. See minicap⁠ for more information.
    • Rotation support
  • Supports typing text from your own keyboard
    • Supports meta keys
    • Copy and paste support (although it can be a bit finicky on older devices, you may need to long-press and select paste manually)
    • May sometimes not work well with non-Latin languages unfortunately.
  • Multitouch support on touch screens via minitouch⁠, two finger pinch/rotate/zoom gesture support on regular screens by pressing Alt while dragging
  • Drag & drop installation and launching of .apk files
    • Launches main launcher activity if specified in the manifest
  • Reverse port forwarding via minirev⁠
    • Access your local server directly from the device, even if it's not on the same network
  • Open websites easily in any browser
    • Installed browsers are detected in real time and shown as selectable options
    • Default browser is detected automatically if selected by the user
  • Execute shell commands and see real-time output
  • Display and filter device logs
  • Use adb connect to connect to a remote device as if it was plugged in to your computer, regardless of ADB⁠ mode and whether you're connected to the same network
    • Run any adb command locally, including shell access
    • Android Studio⁠ and other IDE support, debug your app while watching the device screen on your browser
    • Supports Chrome remote debug tools⁠
  • File Explorer to access device file system
  • Experimental VNC support (work in progress)
• Monitor your device inventory
  • See which devices are connected, offline/unavailable (indicating a weak USB connection), unauthorized or unplugged
  • See who's using a device
  • Search devices by phone number, IMEI, ICCID, Android version, operator, product name, group name and/or many other attributes with easy but powerful queries
  • Show a bright red screen with identifying information on a device you need to locate physically
  • Track battery level and health
  • Rudimentary Play Store account management
    • List, remove and add new accounts (adding may not work on all devices)
  • Display hardware specs
• Use the Booking & Partitioning systems
  • Overview
    • The partitioning system allow you [administrator level] to allocate distinct sets of devices to different projects or organizations (i.e. represented by user sets) for an unlimited period
    • The booking system allows you to reserve a set of devices for a set of users during a limited time (e.g. from 3:00 am to 4:00 am during 5 days)
    • What is common to the booking & partitioning systems is the concept of Group, that is, an association of devices, users and a specification of time
    • Report to GroupFeature.pdf⁠ for detailed documentation on how to use this feature
  • Monitor your group inventory
    • See which groups are active, ready or pending, as well as other group properties: name, identifier, owner, devices, users, class, duration, repetition, starting date, expiration date
    • Search groups by their property values
    • Contact by email the owners of the selected groups
  • Manage your groups
    • Create a group by specifying its name, devices, users and schedule
    • Get ready your group in order it is scheduled by the system
    • Search groups by their property values
    • Remove your group or a selection of your groups
    • Contact by email the owners of the selected groups [administrator level]
• Manage the devices [administrator level]
  • Search the devices by their property values
  • Remove a device or a selection of devices meeting a set of filters: present, booked, annotated, controlled
• Manage the users [administrator level]
  • Create a user by providing his name and his email
  • Search the users by their property values
  • Remove a user or a selection of users meeting a set of filters: group owner
  • Contact a user or a selection of users by email
  • Set the default groups quotas applicable to all users
  • Set the groups quotas applicable to a specific user
• Simple REST API⁠

⁠Status

STF is in continued, active development, but development is still largely funded by individual team members and their unpaid free time, leading to slow progress. While normal for many open source projects, STF is quite heavy on the hardware side, and is therefore somewhat of a money sink. See how to become a sponsor⁠ if you or your company would like to support future development.

We're also actively working to expand the team, don't be afraid to ask if you're interested.

⁠Short term goals

Here are some things we are planning to address ASAP.

1. Performance
2. Properly expose the new VNC functionality in the UI
3. Properly reset user data between uses (Android 4.0+)
4. Automated scheduled restarts for devices
5. More!

⁠Consulting services

We highly encourage open participation in the community. However, if you're running a business that uses STF or would like to use STF, you may sometimes want to have an expert, i.e. one of the original developers or a skilled contributor, work with you to set up a prototype for evaluation purposes, add support for new or old hardware, figure out an issue, fix a bug or add some new feature. Our services are similar to FFmpeg's⁠. [Contact us][contact-link] with details and we'll see what we can do.

Availability is limited and tied to individual developer's schedules.

⁠A quick note about security

As the product has evolved from an internal tool running in our internal network, we have made certain assumptions about the trustworthiness of our users. As such, there is little to no security or encryption between the different processes. Furthermore, devices do not get completely reset between uses, potentially leaving accounts logged in or exposing other sensitive data. This is not an issue for us, as all of our devices are test devices and are only used with test accounts, but it may be an issue for you if you plan on deploying STF to a multiuser environment. We welcome contributions in this area.

⁠Requirements

• Node.js⁠ 8.x required (some dependencies don't support newer versions)
• ADB⁠ properly set up
• RethinkDB⁠ >= 2.2
• GraphicsMagick⁠ (for resizing screenshots)
• ZeroMQ⁠ libraries installed
• Protocol Buffers⁠ libraries installed
• yasm⁠ installed (for compiling embedded libjpeg-turbo⁠)
• pkg-config⁠ so that Node.js can find the libraries

Note that you need these dependencies even if you've installed STF directly from NPM⁠, because they can't be included in the package.

On Mac OS, you can use homebrew⁠ to install most of the dependencies:

brew install rethinkdb graphicsmagick zeromq protobuf yasm pkg-config

On Windows you're on your own. In theory you might be able to get STF installed via Cygwin⁠ or similar, but we've never tried. In principle we will not provide any Windows installation support, but please do send a documentation pull request if you figure out what to do.

We also provide a Docker⁠ container in the Docker Hub⁠ as openstf/stf⁠. You can use our Dockerfile⁠ as guidance if you'd prefer to do the installation yourself.

You should now be ready to build⁠ or run⁠ STF.

Note that while Mac OS can be used for development, it doesn't provide a very reliable experience in production due to (presumed) bugs in ADB's Mac OS implementation. We use CoreOS⁠ but any Linux or BSD distribution should do fine.

⁠Installation

As mentioned earlier, you must have all of the requirements⁠ installed first. Then you can simply install via NPM:

npm install -g stf

Now you're ready to run⁠. For development, though, you should build⁠ instead.

⁠Building

After you've got all the requirements⁠ installed, it's time to fetch the rest of the dependencies.

First, fetch all NPM and Bower modules:

npm install

You may also wish to link the module so that you'll be able to access the stf command directly from the command line:

npm link

You should now have a working installation for local development.

⁠Running

STF comprises of several independent processes that must normally be launched separately. In our own setup each one these processes is its own systemd⁠ unit. See DEPLOYMENT.md⁠ and Setup Examples⁠ if you're interested.

For development purposes, however, there's a helper command to quickly launch all required processes along with a mock login implementation. Note that you must have RethinkDB running first.

If you don't have RethinkDB set up yet, to start it up, go to the folder where you'd like RethinkDB to create a rethinkdb_data folder in (perhaps the folder where this repo is) and run the following command:

rethinkdb

Note: if it takes a long time for RethinkDB to start up, you may be running into rethinkdb/rethinkdb#4600⁠ (or rethinkdb/rethinkdb#6047⁠). This usually happens on macOS Sierra. To fix this on macOS, first run scutil --get HostName to check if the HostName variable is unset. RethinkDB needs it to generate a server name for your instance. If you find that it's empty, running sudo scutil --set HostName $(hostname) has been confirmed to fix the issue on at least one occasion. See the issues for more complete solutions.

You should now have RethinkDB running locally. Running the command again in the same folder will reuse the data from the previous session.

An administrator level is available in STF in addition of the native user one, with increased rights on some features (e.g. booking & partitioning systems, management of users & devices, ...). The corresponding built-in administrator user has the following default credentials:

• name: administrator
• email: [email protected]

Another built-in object exists, this is the root standard group to which the users and devices belong the first time they register to the STF database, its default name is Common

These built-in objects are created in the STF database if they do not already exist

Of course, you can override the default values of these built-in objects by settings the following environment variables before to initialize the STF database through stf local or stf migrate commands:

• root standard group name: STF_ROOT_GROUP_NAME
• administrator user name: STF_ADMIN_NAME
• administrator user email: STF_ADMIN_EMAIL

You're now ready to start up STF itself:

stf local

After the webpack⁠ build process has finished (which can take a small while) you should have your private STF running on http://localhost:7100⁠. If you had devices connected before running the command, those devices should now be available for use. If not, you should see what went wrong from your console. Feel free to plug in or unplug any devices at any time.

Note that if you see your device ready to use but without a name or a proper image, we're probably missing the data for that model in our device database⁠. Everything should work fine either way.

If you want to access STF from other machines, you can add the --public-ip option for quick testing.

stf local --public-ip <your_internal_network_ip_here>

⁠Updating

To update your development version, simply pull the repo and run npm install again. You may occasionally have to remove the whole node_modules and res/bower_components folder to prevent NPM or Bower from complaining about version mismatches.

⁠FAQ

⁠Can I deploy STF to actual servers?

Yes, see DEPLOYMENT.md⁠ and Setup Examples⁠.

⁠Will I have to change battery packs all the time?

No, not all the time. Aside from a single early failure we had within only a few months, all of our devices were doing fine for about two years. However, having reached the 2-3 year mark, several devices have started to experience visibly expanded batteries. Expanded batteries should be replaced as soon as possible. Note that this issue isn't specific to STF, it's just what happens over time. You should be prepared to replace the batteries every now and then. In any case, we consider 2 years per battery pack to be fairly good value for a device lab.

You should set up your devices so that the display is allowed to turn off entirely after a short timeout. 30 seconds or so should do just fine, STF will wake it up when necessary. Otherwise you risk reducing the lifetime of your device.

Note that you may have a problem if your USB hubs are unable to both provide enough power for charging and support a data connection at the same time (data connections require power, too). This can cause a device to stop charging when being used, resulting in many charging cycles. If this happens you will just need to get a better USB hub⁠.

⁠Is the system secure?

It's possible to run the whole user-facing side behind HTTPS, but that's pretty much it. All internal communication between processes is insecure and unencrypted, which is a problem if you can eavesdrop on the network. See our quick note about security⁠.

⁠Can I just put the system online, put a few devices there and start selling it?

Yes and no. See "Is the system secure?⁠". The system has been built in an environment where we are able to trust our users and be confident that they're not going to want to mess with others. In the current incarnation of the system a malicious user with knowledge of the inner workings will, for instance, be able to control any device at any time, whether it is being used by someone or not. Pull requests are welcome.

⁠Once I've got the system running, can I pretty much leave it like that or is manual intervention required?

In our experience the system runs just fine most of the time, and any issues are mostly USB-related. You'll usually have to do something about once a week.

The most common issue is that a device will lose all of its active USB connections momentarily. You'll get errors in the logs but the worker process will either recover or get respawned, requiring no action on your side.

Below are the most common errors that do require manual intervention.

• One device worker keeps getting respawned all the time
  • Rebooting the device usually helps. If the device stays online for long enough you might be able to do it from the UI. Otherwise you'll have to SSH into the server and run adb reboot manually.
  • This could be a sign that you're having USB problems, and the device wishes to be moved elsewhere. The less complex your setup is the fewer problems you're going to experience. See troubleshooting⁠.
  • We're working on adding periodic automatic restarts and better graceful recovery to alleviate the issue.
• A whole group of devices keeps dying at once
  • They're most likely connected to the same USB hub. Either the hub is bad or you have other compatibility issues. In our experience this usually happens with USB 3.0 hubs, or you may have a problem with your USB extension card. See recommended hardware⁠.
• A device that should be online is not showing up in the list or is showing up as disconnected
  • See troubleshooting⁠.

⁠How do I uninstall STF from my device?

When you unplug your device, all STF utilities except STFService stop running automatically. It doesn't do any harm to force stop or uninstall it.

To uninstall the STFService, run the following command:

adb uninstall jp.co.cyberagent.stf

You may also wish to remove our support binaries, although as mentioned before they won't run unless the device is actually connected to STF. You can do this as follows:

adb shell rm /data/local/tmp/minicap \
  /data/local/tmp/minicap.so \
  /data/local/tmp/minitouch \
  /data/local/tmp/minirev

Your device is now clean.

⁠Troubleshooting

⁠I plugged in a new device but it's not showing up in the list.

There can be various reasons for this behavior. Some especially common reasons are:

• USB debugging is not enabled
  • Enable it.
• USB debugging is enabled but the USB connection mode is wrong
  • Try switching between MTP and PTP modes and see if the device appears. This happens fairly often on Mac OS but almost never on Linux.
• You don't have the ADB daemon running
  • Make sure ADB is running with adb start-server.
• You haven't authorized the ADB key yet
  • Check your device for an authentication dialog. You may need to unplug and then plug the device back in to see the dialog.
• ADB hasn't whitelisted the manufacturer's vendor ID
  • Add it yourself⁠ or wait for the new version that removes the stupid whitelisting feature to be deployed.
• Insufficient power supply
  • If you're using a USB hub, try a powered hub⁠ instead (one that comes with a separate AC adapter).
  • Even if you're using a powered hub, there might not actually be enough power for all ports simultaneously. Get a better hub⁠ or use fewer ports.
  • Your device is too power hungry, can happen with tablets. Get a better hub⁠.
• Insufficient USB host controller resources
  • On Linux, use dmesg to check for this error
  • If you've only got 9-12 devices connected and an Intel (Haswell) processor, it's most likely an issue with the processor. If your BIOS has an option to disable USB 3.0, that might help. If not, you're screwed and must get a PCIE extension card with onboard controllers.
• Your powered USB hub does not support the device
  • Can happen with older devices and newer Battery Charging spec compatible hubs. Get a more compatible hub⁠.
• The USB cable is bad
  • It happens. Try another one.
• The USB hub is broken
  • This, too, happens. Just try a new one.
• The device might not have a unique USB serial number, causing STF to overwrite the other device instead
  • This has never happened to us so far, but we do have one dirt-cheap Android 4.4 device whose serial number is the wonderfully unique "0123456789ABCDEF". Presumably if we had more than one unit we would have a problem.

⁠A device that was previously connected no longer shows up in the list.

Again, there can be various reasons for this behavior as well. Some common reasons are:

• The device ran out of power
  • You can see the last reported power level in the device list, unless there was a lengthy power outage preventing the battery level from being reported.
• Someone accidentally disabled USB debugging remotely
  • Yes, it happens.
• An OS update disabled USB debugging
  • Yes, it happens. Especially on Fire OS.
• Someone touched the USB cable just the wrong way causing a disconnection
  • Happens easily.
• Your PCIE USB extension card died
  • Yes, it happens.
• Temporary network issues
  • Can't help with that.
• Someone removed the device physically.
  • Or that.
• You're on Mac OS
  • There's a bug in ADB's Mac OS implementation that causes devices to be lost on error conditions. The problem is more pronounced when using USB hubs. You have to unplug and then plug it back in again.
• The USB hub broke
  • Happens. Just try a new one.

⁠Remote debugging (i.e. adb connect) disconnects while I'm working.

If you're using STF locally, the most common cause is that you're not filtering the devices STF is allowed to connect to. The problem is that once you do adb connect, STF sees a new device and tri