Integrating Tableau Workbooks in Tableau Server

This post explains ways to pass information a web page to a Tableau Workbook on the server.  This web page can be anywhere.

 

Use cases

  • There are visuals in two separate dashboards that users want in one place,
  • A web page passes variables to Tableau Server, and
  • A visibility control mechanism that allows certain visuals for select people.

Note:  This is for Tableau and Tableau Server/Public 10.0 and above.

Embedding a Dashboard Within a Dashboard

 

Sometimes areas want to reuse visuals from one dashboard on another.  Usually this mean making a copy of the visuals and data.  The problem with this is that the visuals will slowly diverge as creators apply updates.  It may even come to the point where they will give different answers, even if both dashboard use the same data source.

To get around this problem, embed the dashboard.  This keeps the source the single version of the truth.

1. In IE 11, Chrome, or Firefox go to the dashboard you wish to embed

 

image

 

2. Click Share > Link

3. Copy the URL link

Note: At this point, web site designers can use this link to embed a visual into a web page if they wish to place the visualization in a Iframe.  However, a better idea would be to use the embed code for best presentation and more control.  This is useful on Microsoft SharePoint, Yammer, and blogs such as WordPress.

 

This is what it looks like when a Tableau Public dashboard is embeded into WordPress.  Sizing is a bit off with this view.  Full version

 

4. In Tableau Desktop, create a Dashboard page

 

clip_image004

 

 

5. Under Objects, select Web Page

6. Drag it to the canvas

7. In the Edit URL popup, paste the link (CTRL+V)

 

clip_image006

 

8. Click OK

 

 

Optional – Sizing

If the linked dashboard linked is larger than the source dashboard it might not fit the view.  To fix this you need to have Tableau adjust the size of the screen. 

Under Size > Fixed Size, choose Automatic  (easiest to use but developers should play with the fixed sized settings for best fit.)

 

clip_image002[7]

 

 

Optional 2 – Look an Feel

Developers can also control the look and feel depending on the options sent via the URL.

 

https://tableau.test.com/views/TestDashboard/TestDashboardPage?:embed=y&:showShareOptions=true&:display_count=no&:showVizHome=no

 

Each of the colored items are options.  You can append as many as you need.

  • :embed=y  —– Turns off Tableau server header and only shows the dashboard
  • :tabs=no   —– Turns off tabs and only shows the linked page of the workbook
  • :toolbar=  —– Turns on and off download and edit toolbar at the bottom of the page
    • Yes
    • No
    • Top
  • :tooltip=no  —– Turns off tooltips
  • :showShareOptions=false  —– Stops people from being able to share the view
  • :format=png  —– Will turn the secondary dashboard to a picture.  Useful to prevent people from downloading the data. It also can be copied into presentations.

More Info: https://onlinehelp.tableau.com/current/server/en-us/embed_list.htm 

Note: These options only work with Tableau Server not Tableau Public.

 

Optional 3 – Filtering

Using Parameters

Developers can pass parameters from one dashboard to another through the URL.  This allows the main dashboard to filter items on the secondary dashboard.

 

https://tableau.test.com/views/TestDashboard/TestDashboardPage?Districts=<Parameters.Districts>&:embed=y&:showShareOptions=true&:display_count=no&:showVizHome=no

 

In this example, the link in the main dashboard contains a parameter that passes along the agency to the secondary dashboard.  Since the test dashboard has a field or parameter called ‘Districts’, this filters the embedded dashboard.  The URL can contain multiple filter-parameters.

The parameter in the main dashboard does not need to have the same name as the field in the secondary dashboard, but it may help with passing variables

See this in action: Link

 

Hard Coding Parameters

https://public.tableau.com/profile/steve.rubendall6256#!/vizhome/SuperstoreSub-WorkbookExample/Overview?State=Iowa

Developers can also hardcode the filters.  This is useful when users need to see only a subset of the data.  In this example will display the state of Alaska.   Some developers will be able to use dashboard actions to finely control what is sent to the secondary dashboard.

See this in action: Link

Note:  This can be used as to filter data based on people’s ID or name.  For instance, a page a user ID via the URL to a dashboard embedded on an intranet site.  This provides good visibility protection for those non-technical users, but should not be on the public internet.

 

Multi-Filter Parameters

Developers can also pass more than one filter in the URL.

 

https://public.tableau.com/profile/steve.rubendall6256#!/vizhome/SuperstoreSub-WorkbookExample/Overview?State=Iowa,Illinois&Category=Furniture

 

Here, there are multiple filter values with State using multiple values.  This displays only career reps in both Alaska and Tennessee.

See it in Action: Link

Other Notes

  • Spaces in filters and valid values need to be changed to %20 (ex: Carol Stream –> Carol%20Stream) for them to work on the web.  Other escape characters may also need to be altered to fit in a URL.

 

image

 

Update #1: In checking with Tableau, it looks like embedded reports do not print to PDF.  This is by design as a security and visibility feature.   This also goes for graphics and web pages that are embedded.

Workarounds

    1. Add a toolbar to embedded dashboard to download it as a separate report.  In the URL string use toolbar=top or toolbar=yes.
    2. Take a screen shot (I use a program called Greenshot for picture perfect capture.)
    3. Make it an online only report and point people to it.  Developers can subscribe users to updates so they always get the latest version of the report when available through a periodic email.

Using Business Objects 4.x to Create Tableau Reports

Tableau Workshops - miso -While Tableau has a great visualization capabilities, getting data into it from other databases is a chore unless the schema is simple.  Joining tables is easily through the GUI, but if the request requires complex filters it soon requires custom SQL. 

When this happens, Tableau is no help making it easy to code the SQL.  There are no hints or prefills like modern code programs have.  Therefore, I leverage the work of my Business Objects Universe authors.  They took the time to create the correct database joins needed to build visualization fast.  While Business Objects doesn’t produce the cleanest SQL, it will nearly always work in Tableau.

image

1. In BOXI (Business Object web version,) create the query

2. On the Query Panel control bar, click View Script

 

image

3. In the Query Script viewer, click Use custom query script

4. Highlight the SQL

5. Right-click > Copy (CTRL + C)

 

image

6. In Tableau, connect to a New Data Source

I have tested this and it works for DB2, SQL Server, and Oracle.  While it can work for Access so long as their is no spaces in table and field names, though there are ways to get around it by switching the [] brackets with double quotes.

 

image

7. Enter your database server information and ID/password.

For this to work, you will need at least Read Only access to the database in question.

 

image

8. If necessary, choose the correct Schema.

Most complex databases will have this, but products such as Access will not.

 image

9. At the bottom of the Table section, double-click New Custom SQL

 

image

10. In the Edit Custom SQL popup, right-click > Paste (CTRL + V)

 

image

The SQL should be displayed.  Now the SQL should be cleaned a bit before clicking OK. 

  • Remove anything after the WHERE or GROUP BY clauses such as FOR READ ONLY.  Most databases don’t like it.
  • If there is custom field formatting in the SELECT clause such as Date formatting remove it.  That is what Tableau is for.  If the SQL will be used in lots of workbooks, I like to give them a standard name.  This makes it easier to keep naming structures constant.
  • CASE as well as Min/Max statements work fine. 
  • If you want, clean the SQL to make it a bit more readable.  Things such as adding friendly field name helps when error checking is necessary.

11. Click OK

Hopefully there are no errors.

 

image

If there is an error click Show Details in the error box to see the problem (this examples show a missing comma after one of the variables.)  Unfortunately, Tableau only show the first error it encounters.

Increase Virtual Memory for Stat Programs

In my work, I run many models using gigabytes and larger datasets.  Even with 32GB of RAM, sometimes programs crash for lack of memory.  Since it is unlikely that my work machine will receive a memory upgrade in the near future, another option is to expand Windows virtual memory.  While this is unlikely to speed up the formulation of results, allows programs more memory space to run models.  

This workflow is for Windows 7.  It will work for Vista, but some of the steps are slightly different for 8 and 10.

 

image

 

  1. On the desktop, click Start
  2. Type control panel

 

image

 

  1. If the Control Panel looks like the above picture, click View by: > Small icons

 

image

 

  1. In the Control Panel, click System

 

image

 

  1. In System, click Advanced system settings

 

image

 

  1. In System Properties under the Advanced tab, click Settings…

 

image

 

  1. In the Performance Options popup, click Advanced tab
  2. On the Advanced tab under Virtual memory, click Change… button

 

image

 

Now there are various ways to change it.  This system has two drives. 

The C: drive is a smallish Solid State (SSD) drive.  While increasing the memory allocation here provides the fastest access time, there isn’t much space in a 256GB drive.  I normally either leave it as [System Managed] or remove it all together to increase space for programs.  If you are going to set it manually, try not to use more that 20% or so of the drive. 

The D: drive is a large traditional hard drive.  Because of its 2TB size and the fact that programs do not install here, it is a good place to store swap disks.  Again, the size should take up too much of the drive unless it is the only thing that will be on it.  Try 64GB to 128GB start and go larger if programs continue to crash.

  1. Click the drive name
  2. Click Custom size
  3. Enter the initial size (MB)
  4. Enter the Maximum size (MB)
    1. This don’t need to be the same, but I like symmetry.
  5. Click Set button
  6. Click OK to close the Virtual Memory Window
  7. Click OK to close the Performance Option Window
  8. Click OK to close the System Options window

Generally, Windows will ask for a reboot.  Do it at the first possibility to enable the suggestion.

Note:  For best results, if you use a traditional hard drive, defrag it first to give Windows a large contiguous block of space on the drive.  It may reduce thrashing.  This step is not necessary on a SSD.  Happy quanting

Building a Steam Machine

Sick of waiting for Valve to come out with their version of a console, I decided to build one myself to replace my Ouya that faithfully powers my viewing experience on my TV.   The Ouya itself is a decent piece of hardware and when paired with Kodi, a media player, it does a decent job playing music and videos.  The problem with it is that streaming sources are limited.  No Amazon, Netflix and Spotify unless you want to do some serious hacking to get it to work.

I had 5 main objectives going into it:

# Goal Result
1 Play saved/online media Better than expected
2 Play CD/DVD Slight better than I expected
3 Play blu-ray Awful.  I will never buy another blu-ray again.
4 Gaming Mixed, but decent
5 User experience Odd, but better than expected
  Overall Better than expected

 

Part 1:  Hardware is like an expensive jigsaw puzzle

After sinking a significant portion of my discretionary income on games and other software over the years, I wanted to enjoy them while sitting in front of my TV like a typical American would do.  After a few weeks of research, I finally had enough information on the hardware to use in building a Steam box and media center.

image

Case:  SilverStone RAVEN Series RVZ01B

What attracted me is what it isn’t, a full size box that looks like a computer siting on it side.  It met all of my criteria.

  • Black – Think thing is actually too black, it is like an invisible monolith when lights are turned low.

  • Holds a full sized discrete graphics card

  • Spot for a Blu-ray player

  • Sits horizontally on top of a audio receiver

In the end, this was the only case that fit the criteria as the box fills an odd middle point between ATX cases that are too big (and look like computers) and typical ITX boxes that are too small to fit a discrete graphics card.  In my experience during the build, the case is great so long as you carefully part out your equipment before the build.

An odd thing is that the case comes with spaces for three 120mm fans, but they only give your two slim styled ones.  I ended up purchasing an Antec TrueQuiet case fan and placing it over the CPU and relegated the ones that came with the case moved to support the graphics card.

During the build, I decided to make the machine use a positive flow, meaning all the fans blow inward.  The case has lots of holes to move air out.  With the graphics card helping fan with exhaust, the machine stays cool and quiet.  Even under stress testing, the machine ran cool (64C for the graphics card and 69C for the processor) with the only audible sound being the processor fan if it was under a heavy load.

 

 

2015-02-26 17_09_20-SILVERSTONE ST45SF 450W SFX12V 80 PLUS BRONZE Certified Active PFC Power Supply

Power supply:  SilverStone ST45SF 450W SFX12V

Upon ignorance of computer power needs, I originally worried that 450 watts wasn’t going to cut it this machine.  Later during testing I found it is actually too large.  The machine peaks at 166 watts at full load.  Oh well, at least it is energy star bronze certified.

I have no real complaints about the power supply outside the cost.  Because the case was small, I had to purchase a SFX based version, which was about 50% more than a typical ATX of the same quality.

 

image

Processor: Intel Core i5-4590S

After a few days of pondering, I choose this over low power Haswell i5 over a comparable high-end i3.  The main reason was I didn’t think a dual core i3 would have the oomph to traverse large directories of files and do complex multitasking functions.

However, this isn’t 2009.  An i3 would have worked fine it all but the most demanding tasks.  If I had it to do over again, I’d save the $50. 

 

image

Motherboard: Gigabyte GA-H97N-WIFI ITX

In most situations, I prefer ASUS boards.  They generally have better power user features I look for and having used their equipment for more than a decade, I understand the company’s idiocracies.  However Gigabyte has always been my second choice because their lower end boards are no-frills and stable.

Fortunately, I came across this motherboard in a previous build and loved it.  It is small, fast, and containing every port needed in a console computer, it pairs perfectly with the case.

I choose this board because:

  • Bluetooth 4.0 – few ITX board have it.

  • Has 802.11 AC – Fast wireless and makes pairing with other devices an easy affair.

  • 8 USB ports (6 USB 3.0 with 2 for the front of the machine)

  • Optical sound out for the 15 year old Sony receiver

  • Good power saving while sleeping (currently < 1.2 watts)

In use, it has never crashed.  The only stability issues were because of BIOS settings, which were solved by shifting the power savings and USB operations to the operating system.

If I fault the board for anything, it is that it only has 2 fan headers, one for the CPU and other for the case. The problem with this is that the case has spots for 3 fans. I ended up splicing them into the single remaining case fan header, but this never causes them to ramp up quickly fast since the power provided by the motherboard is too small.  Fortunately, the case is well vented and the components never go much above 40C in normal use.

 

image

Memory: Corsair Vengeance 8GB (2x4GB)

This machine doesn’t need 8GB.  2 or 4 would be fine.  But it was a $5 upgrade so why not. In real world use, it causes me to never close any program.  Once opened, programs stays that way until reboot since there is little to no overhead in using another half a gig of memory.

I chose this memory purely for the fact that is was cheap and approved by Gigabyte for use in the motherboard.

 

 

image

Drive:  Samsung 850 EVO

For this build, I went for speed and power savings.  So, no large spinning rust drive for storage.  This allowed the machine to only have a SSD.  Since I already use this model main machine, it was an easy choice.  It is fast, sips power, and stable in a low usage environment.

 

 

image

Graphics card:  Sapphire HD 5770 1GB – 100283-3L

A recent throw away from my main machine.   However, it still has life so it got a new home.  Having had this card for about 4 years now, it performs as expected.  1080p is no problem and most eye candy can be upped at the max.  The only reason it was demoted from my main rig was that it had a hard time handling two 1920×1200 monitors.

Originally, I purchased it because reviews highlighted its quiet running.  This is still the case.  During stress testing, the fan never goes above 45% @ 64C, which causes a barely audible hum in a quiet room but easily drown out by a furnace fan.  Wish I could say the same thing about street noise.

The only negative I give is that this card uses a bit too much power.  At idle or playing music, the machine uses 53 watts, peaking around 120 during games, which is low for computer standards, but I’d much rather it use under 40.  Taking the card out lowers usage drops to 30 watts.  My gaming usage patterns will dictate if it stays.

 

 image

Blu-ray player: Panasonic UJ-265 Slot Load

This was the hardest part to source.  Because the case needs a slot-loading player, this is the only one that fits outside the SilverStone branded version that sells for three times as much (and is the same equipment, just rebadged. Unfortunately, it has led to buyer’s remorse since the entertainment industry hates people watching their content on unapproved devices (computers.)

 

image

Remote:  Rosewill RHRC-11001 Remote

The reason I chose this remote was that I already purchased it for my main PC.  Since I never use it, so it was repurposed.  I have little to complain about it.  Once plugged in, it just worked without software.  In Steam and some Metro apps it pairs fine, and Kodi allows find tuning controls and assign buttons to do specific functions.  Best part is it can make the computer go to sleep and wake quickly.

It replaced my PS3 Bluetooth remote.  There is nothing wrong with this remote, but few people code for it, therefore it tends not to work in many pieces of software.  The two issues I had with it is that caused havoc for other Bluetooth devices in the area.  The other issue is that it didn’t have a power button for the computer.

 

image

Keyboard:  Logitech K400

For the price, this is one of the best wireless keyboard integrated mouse combos out there.  Everyone I know has at least one of these hanging off their TV.

  • All functionality works out of the box.

  • It has multimedia keys

  • Has a computer on/off button

  • Good battery life (4 months later and it still has needed new ones)

  • 15’ use

The only negative is the mouse is a track pad, which is a poor substitute for an actual mouse.

This replaced a Fosmon Bluetooth keyboard/touch pad, which I like OK, but for the fact that the range was 8 feet.  To use it, requires the user to sit up and bend toward the screen to work.

Part 2:  Construction ahead

The biggest problem during the build was everything was too big or too long.  All of the parts are meant for larger systems so the ended up being extra lengths of cords everywhere. Where I could, the went around the edge of the case.  Others, I resorted to taping the extra cord to the book of the enclosure with electrical tape.

Installation steps:

  1. Power supply first
  2. Hard drive
  3. Attach the processor and fan to the motherboard
  4. Attach memory to the motherboard
  5. Install motherboard
  6. Attach cabling to motherboard
  7. Attach fan cabling to motherboard
  8. Install Blu-ray player to extra mount
  9. Install Blu-ray cabling
  10. Install graphics card and and cabling to extra mount
  11. Install extra mount to the case and to the motherboard
  12. Attach 4 feet to bottom of the computer to help with airflow
  13. Plug in USB parts as needed

Click pictures to enlarge.

IMG_0905

Housing for the solid state drive.  The computer can hold 3.5” drives.  If you are going to use something smaller, make sure you have a 2.5” to 3.5” mount.  The one the drive is on was from and old OCZ drive.

Tip: When building, attach the power supply first otherwise you’ll waste time taking out the motherboard.

 

IMG_0887

When adding a DVD or Blu-ray player, get Mini to Regular PCIe cord like the one at the top.  The at the bottom doesn’t fit.

 

IMG_0889

Blue-ray player.  To use it, it is better to take off the basel (pictured at the bottom.)

IMG_0925

When installing Blu-ray cabling route it between the graphics car and player.

 

IMG_0881

Graphics card.  It doesn’t fit directly on the motherboard.  Instead the case comes with a small PCIe 16x hookup that attaches to the card,  Then the card attaches to the extra mount that holds the Blu-ray player and graphics card. 

Tip: Remember not to use a graphics card that is more than 10 inches long or it won’t fit.

 

IMG_0933

The top of this is a picture shows how the extra mount attaches to the motherboard’s PCIe x16 slot. 

Tip: If you use a graphics card, you cannot use any additional PCIe slot if the board has one as their will be no room.

 

IMG_0892

Antec fan that faces the processor.  It needs to be set at High to rotate fast enough to move air.

 

IMG_0869

Inside the completed computer, minus the extension for the graphics card and blu-ray player that goes on the right.

 

IMG_0951

Underside of the computer.  Note the 2 fans with dust grills.  At the top right shows where one of the feet should go to improve air flow.

 

IMG_0947

Back side of the motherboard. 

Tip: If using a wireless keyboard, place the dongle near the PS3 port (top-left.)  This port is the first to initialize and will help you get into the BIOS.

 

IMG_0943

Completed computer.  I taped the blue light of the machine with electrical tape because it is super bright.  The thing attached to the second USB 3.0 slot is an extra bluetooth dongle for to extend the range of bluetooth devices.  It is not needed if you use non-PS3 controllers.

Tip: The case is a finger print magnet.  Make sure you clean your hands before assembly.

 

IMG_0961

Controls.  The most useful is the Logitech keyboard and Rosewill controller.

Tip: If you are going to use an RF controller like the Rosewill or Logitech Universal remote, place the receiver as close to the TV as possible.  Otherwise, you have to do funky calisthenics to move around the menus.

 

IMG_1000

Installation with Kodi running.

Tip: Clean equipment before you take a picture.  Digital cameras are a harsh and unforgiving lot.

 

Part 3: BIOS, it thinks too much

Once built, I made numerous changes to the BIOS in an effort to make the machine work properly.  The biggest issue was after waking from sleep numerous parts didn’t wake with it.  In the end, I drew two conclusions:

  1. Turn off anything that wasn’t being used (e.g. serial port)

  2. Let Windows handle the power settings

This meant turning off most legacy ports, old technology compatibility settings, and anything non-UEFI.  This fixed all of the lingering power issues and made most user interface operations extremely responsive.  Any continuing problems at this point seem to be due to software issues.

Eventually I’d like to have the machine to power down to S6 or into hibernation to lower the 1.2 watt stand by power usage, but at this point the S5 lower power mode consumes less than 2 watts, so I can live with that.

IMG_0964

 

Below are the settings I used.  The Blue lines indicate the BIOS user interface tab.  I documented any setting that I thought about.  If it is not on this list, it is set at the default.

Name Set at Why?
M.I.T.    
M.I.T. settings All at Auto Don’t care to overclock, want stability.
Advanced Frequency Settings All at Auto Don’t care to overclock, want stability.
Advanced Memory Settings All at Auto Don’t care to overclock, want stability.
Advanced Voltage Settings All at Auto Don’t care to overclock, want stability.
PC Health States    
–  CPU Fan Speed Control Quiet  
–  System Farm Speed Control Quiet Changing this to be more aggressive messes with my keyboard.  3 fans must draw too much power and affect the USB.
Miscellaneous Settings    
–  PCIe Slot Configuration Gen3 Graphics card is that generation
–  DMI Gen2 Speed Enabled Helps with bandwidth of parts in computer
–  3DMark01 Disabled Who cares?
CSM Support Disabled Have no old parts in the computer so not needed
BIOS Features    
Full Screen LOGO Options Disabled Who cares?
Fast Boot Disabled I will enable it once setting are finalized, but it only shaves a second or two seconds off the boot
Execute Disable Bit Enabled Anti-hacking tool
Intel Virtualization Technology Disabled Processor doesn’t support it
Intel TXT(LT) Support Enabled Anti-hacking tool
Dynamic Storage Accelerator Enabled Lets the hard drive control its own speed
VT-d Disabled i5 doesn’t support virtualization
Win 8 Feature Enabled Have Windows 8.  Didn’t want the use the WHQL setting as I have hacked drivers
–  Boot Mode Selection UEFI only Have modern hardware
– Storage Boot Option Control UEFI only Have modern hardware
–  Other PCI Device ROM Priority UEFI OpROM Have modern hardware
Peripherals    
Initial Display Output PCIe Have graphics card installed
PCH LAN Controller Disabled There are two LAN controllers, but I only need one.  This one had the most problems so it was disabled.
XHCI Mode Disabled No old USB devices
Audio controller Disabled I use the HDMI to my TV for sound
Intel Processor Graphics Disabled Have graphics card installed and one display
Intel Rapid Start Technology Enabled Using a solid state hard drive
Legacy USB Disabled No legacy USB
XHCI Hand-off Disabled No legacy USB
EHCI Hand-off Disabled No legacy USB
Two layer KVM Disabled Don’t have one installed
SATA Configuration   Only changes I made is to disable ports that that are not in use
ISCT Support Enabled All ISCT settings are set to enabled for power savings.
Serial Port Disabled Not in use
Power Management    
Power Loading Enabled Just in case of under voltage to the house
Wake on LAN Disabled  
RC6 (Render standby) Disabled Have graphics card installed
Power On By Keyboard Enabled Ability to wake computer from the keyboard
Power On By Mouse Move Ability to wake computer from the mouse
Platform Power Management Disabled Problems with the computer on wake not recognizing USB equipment.  Causes the graphics card to crash.
ErP Disabled Want to computer to turn on with a controller or keyboard

 

Part 4:  Software, this is where the fun starts

Untitled 2

Tip: Pin programs to the taskbar or the Metro Start menu. Pressing the Windows key will allow usage of installed without much mouse/controller moving.

Operating System:  Windows 8.1 64-bit Home

With all the dislike of 8.1, why choose it over 7 or SteamOS?  I having been using since beta testing Windows 8, I learned it has several advantages in the living room:

  • Metro apps work well on large screens

  • Has native support for USB 3.0 and other peripheral drivers are built into the OS

  • Powers on quick (~3 seconds for this machine)

  • Many tweaks to the user interface make it useful without a mouse

The overall software settings of the machine are for media/game consumption, automation to keep software up-to-date, and power savings.  There is no creativity suites and if Windows had it built in, such as Internet Explorer, Windows Defender, or Reader it was used.

Utilities

Software Use Comments
Notepad++ Text viewer Used to open configuration files and light coding
Greenshot Screen capture Good to do screen captures with a click of a button
Glary Utilities 5 Maintenance Full version automates defragging, software updates, cleaning up temp files and many other annoying maintenance items.
SpeedFan Hardware testing To check on temperatures and other metrics.
FurMark Stress testing  
Spybot Search and Destroy Security I don’t keep it resident.  It is just in case a program goes rogue.
Ad Block Plus for IE Ad Blocker Blocks ads and malware in Internet Explorer.  Also makes the Internet worth surfing.
TightVNC Remote control Allows access to the computer from tablets and other computers.
SCP Controller Driver PS3 software Allows PS3 controllers to work through bluetooth.
MotionInJoy works, but it corrupts other USB devices.

 

Fun software

Untitled

Steam

When the computer powers on, it goes right into Steam Big Screen view.  While it focuses on games, it allows users to favorite non-game software.  This opens up other software to controller or remote usage.

It also allows access to a vast game library, of which about 1/4 are controller based.  In practice however, many of games had mouse only menus or some barrier that prevents pure controller only usage.  I wrote several programs to skip menus or install Xbox controller software for navigation.  However, I tired of writing patches so if a game doesn’t allow immediate play, I uninstall it.

Overall, this keyboardless system works well.  The user interface is fast and intuitive, doesn’t crash and opens up Windows programs to other ways of controlling them without a mouse.

 

2015-02-25_00003

Kodi attempting (and failing) to play a Breaking Bad Blu-ray.  This is why I needed to install PowerDVD.  You’d think that content providers would make it easy to consume (and purchase more of) their products.

Kodi (formerly XMBC)

This is the main reason I built the system.  Ouya spent about 95% of its time in this program.  It was vitally important that this program worked with a keyboard.  It is hard to describe what it does to those that don’t own a large media library.  It helps catalog the thousands of music, podcasts, video and pictures on servers and in the cloud. 

Every day, it pulls in a fresh batch of podcasts and web site RSS feeds to peruse.  It also scans Yahoo! to display the weather to satisfy the old man in me.  In addition, there is a large library of add-ons that add functionality.

Video and Music Add-ons

  • Funamation – A Netflix for anime
  • Crunchyroll – A Netflix for anime, manga, and Asian drama
  • PBS – American public television, need my Frontline fix to keep tab on Putin
  • Rooster Teeth – Funny, got hooked after watching RWBY
  • TED Talks – High minded people talk about changing the world
  • The Onion – America’s news source
  • Udacity – Get your learn on ppl
  • YouTube
  • Pandora – Music streaming, not as good as Spotify
  • NPR – Good for listening to WGLT blues
  • Fusion – A gray market add-on that allow access to nearly everything from Estonian live TV to first run movies.  Best part, no ads.

 

Software Usage Comments
Spotify Audio streaming Awesome audio steaming program
Media Player Classic HC Video player Best video player for desktops and laptops on Windows.  Installed with CCCP.
VLC Video player More for testing video connections.
Calibre E-book/PDF reader Perfect Viewer is so much better.  Too bad that it is Android only
Comic Rack Comic reader Perfect Viewer is so much better.  Too bad that it is Android only
Origin Game store Sometimes I want to play Mass Effect 3.  Despite what people say about the ending it is still an awesome game.
Cyberlink PowerDVD 9 Blu-Ray player It is an OK DVD and Blu-ray player but doesn’t work well with anything but a keyboard and mouse
Netflix Metro app Movie streaming Works well enough to watch shows with a game controller.

 

Failures or things left uninstalled

  • Amazon Music – I purchase music from Amazon.  I thought about adding it, but a server downloads them to a location that I can get to from Kodi.  It does have streaming, but Spotify has a better selection.
  • Amazon Prime – They do not have a Metro app to watch video, so I have to use IE (sigh.)
  • Controlling the mouse with a controller – Never found a good program to easily control the mouse without using a touchpad.  Using a controller is slow and imprecise.
  • Desura – A gaming platform for indie games.  The problem is that it that you cannot use a controller with it (and they want bankrupt.)

Tableau Confernce ‘14-Day 3

0911140712

Let us recap day two’s festivities:image002

  • Most presenters talked about simplified visualizations better convey topics to non-data people.
  • There are few good programs to correct data file imperfections.
  • Most companies present dashboards without insight generalization.  Users need to draw their own conclusions from the visualizations presented.
  • Designers hate pie charts.
  • What is truly evil is the exploding pie chart (which I now know how to make, ha!)

Good morning Seattle!  I got up early today and went for a stroll around the downtown area just before sunrise.  I shot pic above down by the water.  I realize now that one does not simply stroll east-west as the rolling terrain make it more ascending mountains.  I was almost late to rendezvous with my colleagues at the hotel.  Again food at the conference had a high nom factor.

 

Session #12: Keynote: Dr. John J. Medina—The Business Brain

imagesI didn’t have a clue to who Dr. Medina, the author of Brain Rules: 12 Principles for Surviving and Thriving at Work, Home, and School, was before the session and asked around to see if anyone else knew who he was to no avail.  I guess he wasn’t a contestant on Dancing with the Stars or Idol.  I first thought he’d going to go on about how people think or ways to excel at work or home, but instead the topic was sleep.  A great topic indeed.

  • Myth: People use <10% of their brain.  It is actually 50-60%.
  • Myth #2: There are left and right brained people.  There is no evidence of this.  Humans need both to survive.
  • Our brain evolved to survive outside.   We are wired to notice changes in weather, sensing motion, and looking for things that aid in survival.
  • Brain as two parts
  • Generator – Affected by mood, what we eat, sickness and sleep
  • Spotlight – Our attention and stimulus receptors
  • We need around 8 hours of sleep a night.  This occurs in 4 to 5 cycles a night.
  • Why so sleepy after lunch?  It is the brain telling you to take a nap because it is confused.  This happens when the circadian arousal and homeostatic sleep drives are nearing equilibrium.  Take a 26 minute nap. 
  • People who have bi-polar often have problems with the homeostatic sleep drive.  I see this in my mom.  At times, she does not sleep, leading to all sorts of problems.
  • Sleep helps people remember what they learn over the course of a day.  The brain replays the memories to aid learning.
  • Four levels of sleep depravation

    1. Irritability
    2. Worsening working memory
    3. Motor skills worsen
    4. Hallucinations similar to LSD

    Sleep deprived people don’t realize they need sleep in the first two stages, but those around them do.

    How we get sleep depravation

    • 5 days w/6 hours of sleep a night is like being up 48 hours straight (felt that when I was Seattle)
    • If someone is up 18 hours in one day, it takes 3 to 4 days to correct the issue.

    Takeaway:  Sleep is the best career move.  Get some.  Hopefully my boss will let me take naps after lunch, for my health…that’s the ticket.

     

    Session #13: 100 Years of Visualization Best Practices—It’s Time to Stop Making the Same Mistakes

    2014-09-17 17_38_47-Graphic presentation - graphicpresentat00brinrich.pdfAndy Cotgreave gave an interesting speech about Willard Brinton and his book, Graphic Methods for Presenting Facts, which can be read in its entirety online (thank you public domain.) 

    • When zero could be a real number in a visualization, start the axis at zero.  Otherwise the perspective can be distorted.
    • The title and images in the visualization tell their own story
    • Use a checklist to make sure visualization meet the needs of the user

    “Show me the numbers” – Stephen Few

    Keys to data visualization

    1. Data interactivity – Use over time, YoY or averages to give context
    2. Isotype – Use shapes that are similar to what you are measuring.  Like footballs for the number of catches a receiver makes.
    3. Don’t size by area, it is not effective.  Make the keys understandable.

    No, bad Economist, no.

     

    IMG950825

    This was original.

    IMG950828

    This is what Andy created using the same data.  Notice how the convey different a meaning.  The top one is more visceral, but the latter one really tells a positive story (well before ISIS hung is shingle in Iraq and Syria.) 

    IMG950829

    Thanks Patty for the snaps.

    2014-09-17 17_43_28-Graphic presentation _ Brinton, Willard Cope, 1880- _ Free Download & Streaming

    Look! Pie charts even in 1914.  They’re eternal I tell you.

    Note:  This book has some great visualizations.  If you have the time, I’d recommend skimming the book for ideas.

    Takeaway:  The visualizations used can change how the reader perceives the insight.  Think about this when displaying data. Review the book, it is nearly as good as Edward Tufte’s, The Visual Display of Quantitative Information, another one I highly recommend.

     

    Session #14: General Motors Design Center: Connecting a Data-Driven Business with a Visually-Driven Team

    I wasn’t expecting grandeur, after all this was a presentation by a GM, a company until recently was known as Government Motors.  My perception changed as Ben Pope took the mic.  He a affable, witty, and most importantly knew analytics.  He even built his presentation in Tableau and not PowerPoint, I true analytics deity.

    GM implemented a graphic view for their projects forgoing the horrendous UI of Microsoft Project and their other internal project systems. 

    • It is used in 10 design centers worldwide with 2,500 people
    • Built with strong IT and management support (which is needed for analytic project in my opinion)
    • Holds all data sources in one workbook.  The they can make changes centrally and push it to the server.
    • Have 3 analysts working and maintaining their dashboards.

    image

    Picture doesn’t do it justice.

    image

    2014-09-17 18_10_38-Sketch114142222.tiff - Windows Photo Viewer

    Rough sketch of the data workflow.  Missing the piece of pull from Microsoft SharePoint to Access (likely to get user information.)

    Takeaway:  It is important to get your stakeholders involved earlier and have a strategic direction to help analytics teams when creating visualizations.

     

    Session #15: Keynote: Hans Rosling—Future Global Trends: A Fact-Based View

    I was looking forward to Hans Rosling closing out the conference.  I am a big fan of Gapminder.org, a organization he help to found.  A few years ago in the pre-Tableau and Excel 2013 days, I used the software his organization created to make a bunch of dashboards in Flash.  During that time, I got to play with the world data he showed to the audience.  Tableau has this data available natively in its products.

    He ask six questions to the audience.  Before proceeding, take the survey to see if you’re l33t enough to continue:  http://www.cnn.com/2013/12/10/world/gapminder-us-ignorance-survey/

    Answers: http://www.gapminder.org/GapminderMedia/wp-uploads/Results-from-the-Ignorance-Survey-in-the-US..pdf (love the filename)

    Anyway, he was frank and funny, a great presenter.

    • Population in 2100: 5 billion Asia, 4 Africa, 1 Americas, and 1 Europe
    • Peak child will be in 2014 to 2016.  That means their will be only 2.1 billion people under 18 in the world each year from now to 2100.
    • The lack of gender equality lowers fertility in middle income and advanced countries (see China and Japan.)  It has no affect on those making <$1.25/day.  This is because of high child mortality rates, which in turn increase birth rates.
    • Two factors that have contributed most to the declining birth rate: vaccinations (sorry anti-vaxors) and globalization (sorry protectionists and greens)
    • Once families make more than $10/day, birth rate declines .  Children are healthier (survive) and don’t have to work.  They go to school and become more educated after which they make more than their parents and have even fewer children.
    • High-income earners have more children provided there is a high level of gender equality.
    • Most high income countries have a lower birth rate than the replacement rate (2.1 children/woman.)  This means their populations will stabilize and shrink (unless there is immigration.)

     

    Sketch11416219

    I was inspired to draw again during the presentation.  I thought of a way to do rolling overtime with a YoY graphic programmatically directly from a DB2 data source.  When I have the time, I will implement it on a daily basis and make the DBAs cry.

     

    Night

    IMG950713

    The conference let out early on the last day, so I went back to Pike Place Market while it was still open.  It is a cool scene when open with all the activity from locals and tourists.  Much of the food was fresh.  I spied an ostrich and emu eggs for sale.  I thought, briefly about taking one to take back.  Then I realized that I had no place to put it in my luggage.  Even if I could manage, the TSA would not keep it whole (like what happened to my jar of garlic spread, grrr.)

     IMG950715

    Them are some big lobster tails.

    After poking around a bit, the group that I was with headed toward the bay to eat.  After some side treks, we heads to Anthony’s Pier 66, just north of the Seattle Aquarium, where we went to sit up so we looked down on the water.  I ordered swordfish, which was good, but I decided not my favorite type of fish.  It was too cooked.  Fish is better in its natural state–raw.  Overall, the food and service was decent and adequate enough for a bunch of tired convention attendees.

    After eating, everything that had happened hit my mind at once.  It was a zen realization that I was dog tired and only wanted to hit the pillow for a few hours before the early 7am flight back to the Midwest.

     

    The recap for day number three:

    • Sleep is more important than staying up all an finishing the next round of Civilization, get some and often.
    • Edward Tufte wasn’t the first person to think of how to display data.
    • There is no one way to get data into Tableau.  Most companies use CSV or Excel rather than go directly against data stores.
    • IT limitations will cause data analysts to do crazy things.  It is important to collaborate with IT to set up reporting systems correctly.
    • The population will stabilize and get older as the world gets richer.  That is a comforting thought for the future of humanity unless a big rock falls from the sky.

    About the Conference

    The conference overall was slickly produced and well run.  Things of note:

    • The TCC14-Data14 app was well produced and was built on Event Base technology.  It bridged nicely between the virtual and physical world.  Tableau added all of the sessions, happenings, maps, surveys and even a game in the app itself. More impressively, the kept it constantly up to date.  I think that it would be a useful tool for any company wanting to hold events with hundreds of people.
    • Tableau used the app and other technology during check-in to see what programs they needed to add during the conference.  The app was constantly pinging about sessions moving to larger venues or added to accommodate popular topics.
    • The lament the size of the lanyard, but it did have a map in the sleeve so you did have to pull out your phone/tablet to see where you needed to go.
    • Tableau offered nice touch services such as shuttle to and from the hotels and discounts of their stuff.
    • Offered a good brand of non-carbonated unsweet lime water in a can.  Wish I could remember the name of it.  It was weird to drink something flat from a can, but it grew on me in place a of black tea that I usually drink.

    Miscellaneous Stuff

    This is stuff I forgot to mention in the earlier posts or just plain didn’t know where to put it.

    IMG950848

     

    Mount Rainier from the Air by Patty Walsh.

    IMG950718

    Rainy Monday at the Fish Market by Patty Walsh.  The rest of the week was clear and sunny.

     

    0909142140

    Listening to Sir-Mix-A-Lot while staring upwards whilst eating a doughnut.

    0911141805a

    Shiny buildings.

    0908141418

    Looking down from the 10th floor in the Seattle Public Library.  Gave me vertigo.  The place is awesome on the inside, but just pain ugly outside.

    photo

    Mount Rainier again.  This time from Safe Co field.  By Brian Welch.

    Note: Next time, bring a decent camera.

    image

    Not sure where I snapped this.  Decent visualization though.

    Tableau Conference ‘14 Diary–Day 2

    Let us review day 1:

    • Most of the conference goers where relatively new to Tableau, few that I spoke with had more than a year or two of experience.  There are two reasons for this.  Firstly, Tableau has grown rapidly in the last year or two.  The other is the conference seems geared toward newbies.  It also doesn’t hurt that Tableau gives out free passes to new enterprise clients.
    • Many of the presentations to on day one focused on data presentation and little on how to get the data into Tableau.
    • There was little explanation on what insight people received from using Tableau.  Most dashboards created were around user self service.

    IMG950711

    The conference started at 9 instead of 8 today.  I think this was to give marry makers some time to recuperate after last nights festivities. The breakfast was different today, but just as good.

    Session #6: Keynote:  Neil deGrasse Tyson –Science as a Way of Knowing

    Oddly, I wasn’t familiar Mr. Tyson.  I should turn in my geek card.   As co-creator and main host of the new Cosmos series I should have known who he was.  The original inspired me to get into the hard sciences as a kid.

    His presentation focused data should be used to explain the universe and how humans need to be open to new ideas that can challenge how we see the world.

    Source: Tableau blog

    • The tree of life doesn’t have humans at the top.  We are just one of thousands of species on its branches.  Also we are more closely related to mushrooms than to plants.
    • It is not a matter of if, but when we will be hit by a large asteroid.
    • We don’t have to destroy the asteroid to save the planet, only use the gravitational pull of a space ship to alter its course.

    Takeaway: It might not helped me use Tableau better, but it was sure entertaining.  Oh and Pluto is not a planet.

    Session #7: Making a Viz that Stops Traffic

    big_circle_zen_masterMy first real session of the day brought in three Tableau Zen Masters, Paul Banoub, Anya A’Hearn, and Dan Montgomery.  20 or so are chosen each year based on the knowledge of the software based on their contributions to the Tableau community, user feedback, and employee nominations.

    IMG950738

    2014-09-15 19_37_17-

    2014-09-15 19_38_04-

    Thanks for Patty Walsh for snapping these.

    The three all had decent presentation styles focusing on data presentation over analysis.  As a fan of Edward Tufte, I wasn’t a fan of what they has built, but well-crafted.  I felt they were too over produced to be practical for users.  However, they all had great color sense and use of language.

    • Use your dashboards to tell a story
    • Pair down your charts using only ones that will enhance user understanding of the data
    • Match colors and fonts with company standards
    • If putting a visual online, use the Blog size, 650×650 canvas
    • Max number of colors should be 2 to 3
    • Use conversational language to explain visualizations
    • Add pictures where necessary
    • Tableau does not embed fonts, so you will have to screen print specialized fonts and add them as a graphics.
    • Learn by pulling data on topics you love and building visualizations.

    Useful links:

    Takeaway:  The is a trade off with visualizations.  Data heavy ones might be easier for analysts but management and casual users need simple visually pleasing visualizations.  Try to make your works look cleaner and less like Tableau.

    Session #8: Porn, Pokémon & Pop Culture: Using Data That Doesn’t Suck

    Similar to the previous session, a few more Zen Masters and a Tableau employee took the stage.  For whatever reason, I thought that Jewel Loree, Andy Kriebel, and Peter Gilks had a better presentation.  I think it was because they spoke less about their visualizations and more about how to get data into Tableau.

    • Cut and paste is king.  There are few tools that help clean data.
    • Cleaning data it the most time consuming part of creating visualizations (hear-hear.)
    • Excel is still comes before Tableau.  You still need to build the data sets somewhere.
    • KISS is the way to go as user engagement is the key to success.
    • Create your own data to hone your skills.  Use an app like Moves to capture what you do or last.FM to capture your musical life.

    2014-09-15 20_00_51-Paint By Numbers

    ballcodehowto9

    AJIUUmd

    2014-09-15 20_04_06-Jewel Loree

    Note: since my pictures did not come out, I found the visualizations referenced in the presentation from from the presenter’s respective web sites.  Click on the visual to discover more.

    Useful links:

    Takeaway:  Tableau only makes data pretty.  It is still hard to get the data in a useful format.

    Session #9: Keynote: A Conversation with Michael Lewis

    200px-Michael_Lewis_2009I was looking forward to this keynote as I have read a number of his books.  I like how he brings the data users to life without getting into the gory details of the analytics they employ.  Personalities always come before numbers.

    This session was a Q&A that started off stiffly, but as he and Tableau’s Kelly Wright warmed to one another the conversation improved.

    • His stories focus on personalities over data.
    • Most of his stories are about outside or little guys fighting consensus in the marketplace.
    • He related better to people who use theirs instincts vs detached people like venture capitalists.  He finds it hard to connect with quants and entrepreneurs.  The are too detached.
    • He likes using a minimalist writing style and does not use jargon.
    • Pairs down is story and leaves part unsaid to to let the reader interpret.

    Lewis-Wright-300x136

    • Thinks that the right-left divide in the country was due in part to the financial crisis.
    • The financial sector is scared of change.  Many people fear technological change will cause them to loose their jobs.
    • Thinks there is a disconnect in capital markets.  Most people working on Wall Street are free agents and don’t hold allegiances to their employer of customers.  This is harmful.
    • He gets writing ideas from talking to people in his network.

    Books I have read w/Twitter reviews:

    Links

    Takeaway:  Work to pair away your data until you can see the story you want to tell.

    Session #10: Use Tableau like a Sith

    image

    In the end, I am not sure what I got our of the Sith presentation done by Darth Flashypants, and Jinbar Nomix.  It focused on hacking Tableau desktop and server to bend it to the will of the user.

    Much of the time, I spent wondering if I would use anything they presented in real life.

     

     

    • Tableau employees hate pie charts.
    • Tableau Data Stores are in XML.  If one knows how to decode the parameters in the file, they can change a file saved in 8.2 to open in earlier versions, create pivot tables with more than 16 columns of data, change Excel connections to Access connections, and muck around to point at Internet URLs to pull in pictures rather than embedding them in the file.
    • There is a way to create exploding pie charts using dual axis charts.
    • There is a way to create gauges, but it is so complex why would you?
    • You can use a jitter function to show over-lapping data points.
    • There was a lot on how to improve Tableau Server performance, but since I am not a server admin, I didn’t bother to capture it.

    Links

    Takeaway:  Tableau uses XML, so it is possible to do some cool things if you know how to read it.

    Session #11: BI Reboot at Coca-Cola: Driving Sales with Tableau

    Chathura Manawadu was wonderful.  This was the best presentation of the day and a great note to go out on.  He created a dashboard called SalesPulse for the thousands of Coca-Cola distributors that interact with the local Walmart and mom and pop stores.

    2014-09-15 20_57_43-

    image

     

    • Designed their metrics from the bottom up as they implemented Tableau.
    • Package the dashboard weekly by division.  3,500 users pick the packaged Tableau workbook off a file share and can use it when offline.
    • Use a consistent color schema for all dashboards they create.  Schema are color-blind friendly.
    • Track sales, volume, and R.E.D. score.Sketch1627410
    • In the back end, use Business Objects connected to Teradata or Microstrategy connected to MS SQL databases and Excel files.

    Links

    Takeaway:  Companies can use reader to distribute dashboard to field users. It just takes some effort to make it happen.

    Night

    At night we took Seattle’s light rail to see a baseball game.  I continue to be impressed by the cities transit.  Chicago’s pales in comparison.  There is little graffiti, it is cheap and it seems to connect bus, monorail (which I don’t think many ride,) and their funky trolley system well.

    09101419020910141859

    Safeco Field and Century Link field, where the Seahawks play are right next to each other on the south side of the downtown.  Personally, I like the building aesthetic of the Seahawks field, but Safeco’s upper decks view has an unparalleled view of the city.  It is the best view from any park I have been to date.

    30garlicfries

    Garlic fries is a local Mariners fan favorite.  The first third was overpowering, the second third wasn’t too bad…the last part was more garlic than fries.  Vampires beware.

    0910141918

    In the upper deck, it was a cold clear and clam night.  The stars were out but the Mariners lost to the Astros.  I thought their pitching was decent, but their hitting line up was scattered and weak.  Luck is the only way they will sneak into the wild card playoff spot.

    Update: 10/21/2016: Sine spell corrections.