A curated list of open technology projects to sustain a stable climate, energy supply, biodiversity and natural resources.

Recent Releases of Transportation Fuels Reporting System

Transportation Fuels Reporting System - v1.4.15

Pull Requests

PR #1292 Edit Address

Managing users can now edit their organization's address

  • Removed unused Primary flag from organization address table
  • Migration to set the effective dates for the organization address
  • Updating an organization address now uses the effective and expiry dates to keep track of the previous addresses
  • Created permission for Managing users

Database Migrations

  • 0152_edit_organization_address_permission.py // PR #1292
  • 0153_remove_organizationaddress_primary.py // PR #1292
  • 0154_add_address_effective_dates.py // PR #1292

Implemented Trello Cards

PR #1292 Edit Address

Technical Information

This release was deployed on Dev July 4 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.14

Included Pull Requests

PR #1287 Summary fixes

Fixed the input field not allowing numbers unless max value was set
Fixed a caching issue with the summary page
Total Payable should no longer show negative values
Fixed a bug with the Fuel Supplier autocomplete causing the page to crash if a company isn't found

PR Schedule_Report_Tab_Col_Comments #1290

Updates to table and column comments for the schedule reports.

Implemented Trello Cards

PR #1287 Summary fixes

Technical Information

This release was deployed on Dev July 4 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.13

PR #1281 Compliance Report Button and Totals window

Fixed buttons to the bottom. Totals no longer overlap on the spreadsheet

  • Removed position: sticky from button toolbar
  • Totals no longer start on top of the spreadsheeet
  • Set bounds for totals so it can't go off screen

PR #1284 Schedule buttons

Schedule D tab names is now based on Fuel Type and Carbon Intensity
Moved the buttons into the main container so there's less repeating code.
Removed the unnecessary required props after.
ESLint fixes

PR #1281 Compliance Report Button and Totals window

PR #1284Schedule buttons

PR #1284 Schedule buttons

Technical Information

This release was deployed on Dev July 3 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.12

Included Pull Requests

PR #1251 Allowed negative values in schedule D output

Input fields in Output section can now accept negative values

  • Allow negative values in Schedule D
  • Total value is now bolded

PR #1267 Schedule summary calculation

Added some calculation in the Summary page

  • Line 1 and 12 should now fetch from Schedule B and C
  • Line 2 and 13 should now fetch from Schedule B and C
  • Line 3 and 14 should now calculate based on the previous lines
  • Line 4 and 15 should now get the calculated values based on the percentage depending on the fuel class
  • Line 5 and 16 should now fetch from Schedule A
  • Schedule B refactoring to reduce number of repeated code
  • Editing Schedule B should now reload the calculations

PR #1272 Schedule summary calculation

Added more calculation for the Summary Page

  • Line 6 and 17
  • Line 8 and 19
  • Line 10 and 21
  • Line 11 and 22

PR #1276 Fix an issue where selecting a blank fuel class causes a js error

Updated some of the labels and fixed an issue where a blank fuel class is causing the page to crash

  • Updated some text
  • Value is checked before being added for the energy effectiveness ratio so it doesn't crash the page

PR #1283 Fixed delete key interaction with the spreadsheet

Fixed the delete key interaction with some of the columns

  • Delete on Quantity now clears the cell properly
  • Delete on Fuel Type clears the drop-down properly and clears the other options as well

PR #1284 Schedule buttons

Schedule D tab names is now based on Fuel Type and Carbon Intensity
Moved the buttons into the main container so there's less repeating code.
Removed the unnecessary required props after.
ESLint fixes

PR #1282 Clean up Openshift templates

Implemented Trello Cards

PR #1251 Allowed negative values in schedule D output

PR #1267 Schedule summary calculation

PR #1272 Schedule summary calculation

PR #1276 Fix an issue where selecting a blank fuel class causes a js error

PR #1283 Fixed delete key interaction with the spreadsheet

PR #1284 Schedule buttons

Technical Information

This release was deployed on Dev July 3 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.11

PR #1243 Fuel Code Error Indicator and Proper validation

Added proper validation to check if there are conflicting dates

  • Added a new filterFuelCode action
  • Validates against multiple fuel codes to actually get the conflicting fuel code
  • Added tooltip on hover in the fuel codes list page

PR #1246 Rounded Credits, Debits and Totals

Removed decimals for the credits, debits and totals

  • Fixed an issue where the second parameter for formatNumeric doesn't do anything
  • Replace Number with Math.round so it doesn't need Number anymore

PR #1247 Added timestamps in notification-server logs

Add logging with timestamps to notification server output

PR #1248 Added migrations to fix sequence table names

Changed the sequence table names so that it matches the actual tables.
Updated the version for django to fix some vulnerability.

Database Migrations

  • 0151_rename_table_sequences.py // PR #1248

PR #1243 Fuel Code Error Indicator and Proper validation

PR #1246 Rounded Credits, Debits and Totals

PR #1247 Added timestamps in notification-server logs

Technical Information

This release was deployed on Dev Jun 24 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.10

Pull Requests

PR #1233 Schedule B Backend

Schedule B Models, Serializers, and backend tests
Preliminary integration with frontend

PR #1238 Renamed Login buttons classes

This is so that ad blockers won't hide the login buttons.
Also, removing release.md as it's not being used.

PR #1240 Fixed Wrong Carbon Intensity Limit being fetched

Added a new filter for fetching carbon intensity limit, so it actually filters by compliance period

PR #1182 [Snyk] Fix for 1 vulnerable dependencies

Database Migrations

  • 0150_auto_20190619_1733.py //PR #1233

PR #1233 Schedule B Backend

PR #1238 Renamed Login buttons classes

PR #1240 Fixed Wrong Carbon Intensity Limit being fetched

Technical Information

This release was deployed on Dev Jun 21 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.9

Included Pull Requests

PR #1229 Schedule summary

This creates the container and tab for Schedule Summary.
Note: No back-end or calculation yet

PR #1226 Frontend Refactoring

Create a ComplianceReportingEditContainer container to hold all schedules and push state up to this level
Schedule A saving now works as expected, and it should now be much simpler to implement the remaining schedules
Child components receive complianceReport in a prop

Fixed schedule-b when selecting fuel type #1232

Implemented Trello Cards

PR #1229 Schedule summary

Technical Information

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.8-dc-pipeline-fix

Release Notes:

When deploy v1.4.8 on test, the previous release was v1.3.10. All the migrations went through smoothly, the operational script 0012 and 0013 were applied without any issues. But script 0014 (belongs to release 1.4.5) failed because the migrations after v1.4.5 including changes against it.
Developers fixed the issue by putting in fixes for 0014 and removing 0015.

PR #1227 Updated the fixtures so it works with the new migrations

Since we refactored the migrations, the fixtures no longer work as well, so this should update it so it works with the new migration.
This also fixes a permission error for the autocomplete with the compliance report.

Deployment config and pipeline fix

Technical Information

This release was deployed on Test Jun 18 2019.
This release was deployed on Prod Jun 18 2019.
The changes included were rebased to master at Jun 19 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.8

PR #1218 Schedule b alternative method

Alternative method now shows an input field for carbon intensity
Fixed an issue where some of the logic carbon intensity and carbon intensity limit where swapped
Alternative method enables input field for carbon intensity
Some refactoring

PR #1222 Schedule D

Created Schedule D

  • Created front-end container for Schedule D
  • Created tabs for multiple sheets for Schedule D
  • Automatic calculation of total and carbon intensity

PR #1215 Schedule A Backend

Backend components for Schedule A
Integration with frontend pending, since a refactor of the Compliance Reporting Container is required

PR #1219 Fixed migration conflict

Database Migrations

  • 0149_auto_20190612_0150.py //PR #1219, #1215

Implemented Trello Cards

PR #1218 Schedule b alternative method

PR #1222 Schedule D

Technical Information

This release was deployed on Dev Jun 13 2019.
This release was deployed on Test Jun 18 2019. Please refer to v1.4.8-dc-pipeline-fix
This release was deployed on Prod Jun 18 2019. Please refer to v1.4.8-dc-pipeline-fix

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.7

Operational Notes

Run 'python manage.py load_ops_data api/fixtures/operational/0015_update_provisions_of_the_act.py' on all three environment

Pull Request

PR #1200 Improved autosave support for Schedule C

Improved autosave support for Schedule C, including invalidation and better (datasheet-aware) reloading of the saved state.

PR #1209 Schedule B - Credit Calculation Values

This is mostly to automatically fetch the credit calculation values upon selection of fuel code or when it's applicable.

  • Quite a number of migrations to do the following:
    -- Renamed carbon_intensity_determination_type to determination_type
    -- Removed description from determination_type
    -- Renamed fuel_provisions to provision_act
    -- Added provision to provision_act
    -- Renamed approved_fuel_provision to carbon_intensity_fuel_determination
    -- Moved determination_type from provision_act to carbon_intensity_fuel_determination
  • Removed filter from FuelCode viewset
  • Created Credit Calculation viewset
  • Created Serializer for Credit Calculation
  • Allowed additional parameters for doFind and doGet
  • Added automatic selection of fuel class and provision if only one is available
  • Added automatic population of credit calculation values
  • Added automatic fetch of fuel code carbon intensity if applicable
  • Default action of New Compliance Report changed to show drop-down
  • Quantity Column automatically adds commas for every 3 digits
  • ESLint fixes

PR #1199 Devops apply backend dc in pipeline

Backend has a new environment variable, the deployment config needs to be replaced.

Implemented Trello Cards

PR #1209 Schedule B - Credit Calculation Values

Technical Information

  • This release was deployed on dev Jun 12 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.6

Operational Notes

New environment variable for backend COMPLIANCE_REPORTING_API_ENABLED=true

Pull Requests

PR Fix Import #1197

Fix a broken import preventing the page from loading correctly

PR Devops pipeline cleanup #1193

Technical Information

This release was deployed on Dev Jun 4 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.5

Operational Script

Run "python manage.py load_ops_data api/fixtures/operational/0014_add_provisions_of_the_act.py" in all three environment

Pull Request

PR #1187 Schedule b

This should create the basic schedule B form. Still lacking some fuel code functionality for the sprint.]

  • Added Provisions of the Act Model
  • Created an operational script to prepopulate the provisions of the act table
  • Created routes for Schedule B
  • Consolidated managers that uses the_type
  • Added front-end for the Schedule B
  • Added classes to the columns so they're spaced out based on their possible content and so that it gets a horizontal scrollbar when it's too wide
  • Various fixes to the front-end
  • Removed auto-save from fuel-code

PR #1196 Compliance reporting frontend integration

Database Migrations

  • 0138_auto_20190530_1823.py //PR #1187

Implemented Trello Cards

Technical Information

This release was deployed on Dev Jun 4 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.4

Operational Scripts

Run "python manage.py load_ops_data api/fixtures/operational/0013_add_notional_transfer_types.py" in all three environment

Pull Request

PR #1180 Schedule a

This will get some migration conflicts. So I'll have to fix that first. It looks like it has other conflicts as well. Anyway, this doesn't need to go in right away, I just want to push it up for review. I'd like Rob's PR to go in first.

  • Schedule A front-end should be done
  • Fuel Class drop down is coming from the database
  • Received or Transferred are coming from the database as well
  • Special Autocomplete for the Fuel Supplier name
  • Address is pre-populated upon selection of Fuel Supplier
  • Totals should be a floating element and can be moved
  • Cleaned up the serializers and viewsets

PR #1181 Pr pipeline use new templates2

PR #1135 Fix for 1 vulnerable dependencies

PR #1192 remove snyk-protect

Database Migrations

  • 0137_notionaltransfertype.py // PR #1180

Implemented Trello Cards

PR #1180 Schedule a

Technical Information

  • This release was deployed on Dev Jun 4 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.3 Build Templates and Pipeline Update

PR #1176 PR pipeline use new templates

Technical Information

This release was deployed on dev May 29 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.2

Pull Requests

PR #1168 Effective dates overlap modal

Reworked how the modal shows up to ask the user whether they're sure in adding a fuel code

  • Moved the modal check into the form
  • Added a validation for the effective dates on clicking the add button
  • Added another reducer to prevent clashes in edit

PR #1171 Ux improvements

Minor ui changes and eslinting

  • Added paddings and margins for the compliance reporting tabs
  • Added past and present values for Petroleum-based carbon intensities
  • ESLint

PR #1174 Effective dates overlap modal

Fixed some bugs found when updating.

  • Fixed a bug where the fuel code id is getting overwritten by the latest one (so old one never gets updated)
    Added highlighting in the table view

Implemented Trello Cards

PR #1168 Effective dates overlap modal

PR #1174 Effective dates overlap modal

PR #1171 Ux improvements

Technical Information

This release was deployed on dev May 29 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.1

Included Pull Requests

PR #1163 Government roles should only show up when creating IDIR users

The auto-filter was accidentally removed . This should add back the logic to show the roles based on the user being created.

PR #1166 Schedule edit container

Added confirmation and alerts for deleting

  • Moved some of the functionality to the button container
  • Reduced duplication of some of the code
  • Added confirmation for deleting
  • Added toastr pop-up for deleting

Implemented Trello Cards

PR #1163 Government roles should only show up when creating IDIR users

PR #1166 Schedule edit container

Technical Information

This release was deployed on dev May 22 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.4.0 Fuel Code Management

Pull requests

PR #1155 Add Autosave Support

Add an HOC, autosaved which wraps other components to give them the ability to persist autosaved data (state, most likely) on the server side.
Takes a config object as a parameter, with the form
{ name, key, version }, and provides wrapped classes with four new props:
name should be the type of form.
version should change if there are breaking changes to the form
key should represent the unique instance being edited (eg '1' or 'unsaved')
updateStateToSave is a function that takes a state that should be persisted (call it in handleInputChange or similar)
updateAutosaveKey is a function taking a key and will update key if necessary
loadedState is the state retrieved from the backend, if any
saving is true when a save is in progress (for displaying and icon)
Loads before rendering the wrapped component and passes loadedState as an initial prop
Saves on componentWillUnmount. It would be trivial to have it save every 30s or something too.
Added backend support including expiry of old entries
Wired up FuelCodeAddContainer as a demo. Try creating a new fuel code to see it work.

PR #1159 Create Compliance Report and Intro

Added the compliance report list page and create button

  • Compliance Report list page
  • Added button for creating Compliance Reports
  • Added Compliance Report Intro page
  • Removed a configuration from front-end (can just calculate it)

PR #1160 Development environment improvements

  • Replace mailslurper with a basic python SMTP logger
  • Add more compliance periods to dockerized ops scripts and bundle the credit calculation scripts into it
  • Fix operational script 0008 to deal with renamed energy density categories
  • Add react-hot-loader dependency and integrate with docker webpack config
  • Chunk splitting and HTML generation for dev-server to improve compile times
  • Minio bucket created on startup if it doesn't exist

PR #1161 Fixed migration conflicts

Database Migrations:

  • 0130_auto_20190513_2144.py //PR #1161
  • 0131_autosavedformdata_last_access.py //PR #1161

Implemented Trello Cards

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.3.12

Operational Notes

Run "python manage.py load_ops_data api/fixtures/operational/0012_add_fuel_expected_uses.py" in all three environment

Pull Requests

PR #1150 Schedule C

Added Schedule C under the new Compliance Reporting navigation.

  • Installed React Datasheet
  • Drop-down for Fuel Type
  • Drop-down for Fuel Classes that's validated by Fuel Type
  • Unit of Measure auto-populated based on Fuel Type
  • Quantity is auto formatted (commas every 3 digits) with restrictions on decimals and positive only
  • Paste from clipboard is automatically validated

PR #1153 Schedule C - Expected Use and Other column

Added options for Expected Use and conditions for Other column

  • Added model and migration for Expected Uses
  • Added viewset, serializer for Expected Uses
  • Loading options for Expected Use in the spreadsheet
  • Added a trigger to enable/disable the last column as needed
  • Added row number
  • Changed hard-coded column number to use constants instead
  • Added totals as a floating object on the lower right portion of the page
  • Allow adding multiple rows

Database Migrations

  • 0129_expecteduse.py //PR #1153

PR #1150 Schedule C

PR #1153 Schedule C - Expected Use and Other column

Technical Information

This release was deployed on dev May 16 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.3.11

Pull Requests

PR #1141 Indicator for Credit Calculation Tables

Added an "Excel" like indicator for upcoming changes to the densities or ratios in the compliance period tables

  • Added a front-end indicator to show that there's going to be a change in the value
  • Value + effective date tooltip on hover
  • Code cleanup in Serializer

PR #1142 Show past and future values for compliance reporting tables

Added allValues to detail api responses for compliance reporting items
Added tab to show past and future values in detail views
Values are grouped by effective date, with the most recently created in each group selected

PR #1144 Token generation

Migration to strip query parameters from urls in the database
Backend generates a fresh token on each download request
Don't upload the token as part of the attachment creation

PR #1148 Changed the indicator to an icon

Changed the icon so that it's an icon, instead of a triangle in the corner

PR #1147 Prevent resubmission of files with failing security scan

Restrict the ability to try and submit a file after it has already failed the security scan

PR #1137 Two new pipeline for Jenkins basic

The two new pipelines use openshift/jenkins-client-plugin to replace openshift/jenkins-plugin. The jenkins-plugin only supports OpenShift versions up to v3.11

PR #1143 Update Openshift templates

Database Migrations

  • 0128_clean_filenames.py // #1144

Implemented Trello Cards

PR #1141 Indicator for Credit Calculation Tables

PR #1142 Show past and future values for compliance reporting tables

PR #1144 Token generation

PR #1147 Prevent resubmission of files with failing security scan

Technical Information

This release was deployed on Dev May 9 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.3.10

Operational Scripts

  • Run "python manage.py load_ops_data api/fixtures/operational/0011_add_petroleum_based_carbon_intensities.py " in all three environment

PR #1138 Fixed roles page not loading for fuel suppliers

PR #1136 Petroleum based carbon intensities

Closed the other one as I got more clarification. This is another table for Petroleum-based carbon intensities

  • Added Model
  • Added migrations
  • Added Serializer
  • Added Viewset
  • Added frontend support
  • Renamed and reused some components from default carbon intensity

Database Migrations

  • 0126_auto_20190502_2024.py //#1136
  • 0127_add_petroleum_carbon_intensity_categories.py //#1136

Implemented Trello Cards

Technical Information

This release was deployed on Dev May 6 2019
This release was deployed on Test May 9 2019
This release was deployed on Prod May 9 2019

  • celery v5
  • client v70
  • notification-server v15
  • scan-coordinator v7
  • scan-handler v5
  • tfrs v105

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.3.9

Operational Notes

  • Run "python manage.py load_ops_data api/fixtures/operational/0010_update_carbon_intensity_limits.py" in all three environment

Pull Requests

PR #1126 Credit calculation update changes

Changed how the update works, then refactored it as it was getting a lot of duplicate codes

  • Created get in CreditCalculationService
  • Created update in CreditCalculationService
  • Updating a record, now creates a new one instead, and updates the expiry dates accordingly to avoid any overlaps or gaps
  • Added tests to check if updates are working as expected

PR #1128 Added a migration to set fuel to lowercase in renewable fuel in relation within the Default Carbon Intensities table

A simple migration to set Fuel to lowercase.
Added a catch in the saga so it doesn't generate a console error after it redirects you.

PR #1130 Auto populate fuel code

Added a pre-populate function after selecting a fuel code version (user will be prompted)

  • Added Callable Modal for front-end
  • Added a new route for getting the latest fuel code
  • Added a way to disable caching for autocomplete
  • Added front-end test for formatting the facility nameplate
  • Added back-end test for getting the latest fuel code
  • Code linting

PR #1134 Organization ID is now being saved when filtering in credit transactions page

Database Migration

  • 0125_lowercase_renewable_fuel.py // PR #1371

Implemented Trello Cards

PR #1126 Credit calculation update changes

PR #1128 Added a migration to set fuel to lowercase in renewable fuel in relation within the Default Carbon Intensities table

PR #1130 Auto populate fuel code

Technical Information

  • This release was deployed on Dev May 2 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.3.8

Pull Requests

PR #1118 Fixed ordering in spreadsheets. Includes drafts and removes extra period

Stuff fixed during review.

  • Ordering should be by version now, instead of ID
  • Remove extra period from Fuel Code
  • Should include drafts now
  • Added Effective and Expiry Dates to the categories for consistency
  • Added credit_calculation_only column to serializer
  • Added a check to the front-end to exclude the credit_calculation_only rows in Add/Edit Fuel Codes

PR #1121 PR Renewable fuel codes

Adds a checkbox and input field for renewable percentage

  • Updated the Fuel code model to include renewable percentage
  • Updated the Approved Fuel model to add an indicator on which fuel types can have partial
  • Adds a checkbox to the front-end to enable/disable renewable percentage (only applicable to certain fuel types)
  • Updated the serializer to accommodate the new column

PR #1123 Reset page number after filtering.

When go to a page with a table and navigate to the last page, then try to filter, it shows a blank table.
The issue is caused by the page number being higher than the total number of pages.
The fix here is to reset the page number to the first page after filtering, which is the default behaviour for the react tables.

Database Migrations

  • 0122_auto_20190425_1514.py //PR #1118
  • 0123_auto_20190424_1639.py //PR #1121
  • 0124_update_partially_renewable_fuels.py //PR #1121

Implemented Trello Cards

PR #1118 Fixed ordering in spreadsheets. Includes drafts and removes extra period

PR #1121 Renewable fuel codes

Technical Information

This release was deployed on dev Apr 30 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 6 years ago

Transportation Fuels Reporting System - v1.3.7

Only one Pull Request is included in this release

PR #1122 Fixed Roles page breaking for organizations

Technical Information

This release is deployed in Dev Apr 26 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.3.6

Pull Requests

PR #1117 Carbon intensity limits edit

Fixed an issue where the front-end is crashing after updating. (happens on Default Carbon Intensity Edit and Energy Effectiveness Ratio)

PR #1116 Update for staging

Update pipeline to use Dev as testing env for product owner, Test as staging env for demo and Prod for client.

Implemented Trello Cards

Technical infomation

This release was deployed on Dev Apr 25 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.3.5

Pull Requests

PR #1115 Include update serializers for all compliance reporting tables

Include update serializers for energy density, energy effectiveness ratio, default carbon intensity, and carbon intensity limits
Wire up corresponding edit containers to the backend

PR #1104 Add disk usage monitor to Nagios

Implemented Trello Cards

PR #1115 Include update serializers for all compliance reporting tables

Technical Informtion

This release was deployed on dev Apr 24 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.3.4

Operational Notes

Dev

Backend

Ask Developer to clean up the data
Load the following data after tfrs pods are brought down and before database migration completed

  • python manage.py load_ops_data api/fixtures/operational/0007_add_energy_effectiveness_ratios.py
  • python manage.py load_ops_data api/fixtures/operational/0008_add_default_carbon_intensities.py
  • python manage.py load_ops_data api/fixtures/operational/0009_add_energy_densities.py

Test

Backend

  • Load the following data after tfrs pods are brought down and database migration completed
    ** python manage.py load_ops_data api/fixtures/operational/0005_add_new_compliance_periods.py
    ** python manage.py load_ops_data api/fixtures/operational/0006_add_carbon_intensity_limits.py
    ** python manage.py load_ops_data api/fixtures/operational/0007_add_energy_effectiveness_ratios.py
    ** python manage.py load_ops_data api/fixtures/operational/0008_add_default_carbon_intensities.py
    ** python manage.py load_ops_data api/fixtures/operational/0009_add_energy_densities.py
  • TFRS environment variable CREDIT_CALCULATION_API_ENABLED = True

Frontend

"compliance_reporting.enabled": false,
"credit_calculation_api.enabled": false,
"compliance_reporting.starting_year": 2017

Prod

Backend

  • Load the following data after tfrs pods are brought down and database migration completed
    ** python manage.py load_ops_data api/fixtures/operational/0005_add_new_compliance_periods.py
    ** python manage.py load_ops_data api/fixtures/operational/0006_add_carbon_intensity_limits.py
    ** python manage.py load_ops_data api/fixtures/operational/0007_add_energy_effectiveness_ratios.py
    ** python manage.py load_ops_data api/fixtures/operational/0008_add_default_carbon_intensities.py
    ** python manage.py load_ops_data api/fixtures/operational/0009_add_energy_densities.py
  • TFRS environment variable CREDIT_CALCULATION_API_ENABLED=true

Frontend

"compliance_reporting.enabled": false,
"credit_calculation_api.enabled": false,
"compliance_reporting.starting_year": 2017

Pull Requests

PR #1099 Credit calculation model changes

Had to rearrange how the models are all associated. Some data in approved fuel types are supposed to be considered under a name based on the regulation when finding out what the energy density, energy effectiveness ratio, etc.
So I figured I'd just create additional models to categorized them

  • Added Energy Density Category
  • Added Energy Effectiveness Ratio Category
  • Added Default Carbon Intensity Category
  • Changed foreign key of energy density to the related category
  • Changed foreign key of energy effectiveness ratio to the related category
  • Changed foreign key of default carbon intensity to the related category
  • Added new migrations
  • Moved unit of measures into the Approved fuel type model
  • Added migrations to populate the unit of measures
  • Fixed the serializers, viewsets, tests and front-end

PR #1100 Fixed the fuel code version number

The version number wasn't showing the xls download. This should fix it

PR #1103 Fuel descriptions

This adds descriptions (or alternative names) for Approved Fuel types. It adds a relationship to classes as well

  • Added description column
  • Added ApprovedFuelClass model
  • Added FuelClass serializer
  • Added fuel_classes property to ApprovedModel
  • Adds the table to the front-end

Database Migration

  • 0111_update_credit_calculation_fuel_types.py //PR #1099
  • 0112_auto_20190411_1530.py //PR #1099
  • 0113_auto_20190411_1551.py //PR #1099
  • 0114_add_categories.py //PR #1099
  • 0115_auto_20190411_1615.py //PR #1099
  • 0116_add_categories_to_approved_fuel.py //PR #1099
  • 0117_add_unit_of_measures.py //PR #1099
  • 0118_approvedfuel_description.py //PR #1103
  • 0119_add_approved_fuel_descriptions.py //PR #1103
  • 0120_approvedfuelclass.py //PR #1103
  • 0121_add_fuel_class_relationships.py //PR #1103

Implemented Trello cards

PR #1099 Credit calculation model changes

PR #1100 Fixed the fuel code version number

PR #1103 Fuel descriptions

Technical Information

This release was deployed on Dev Apr 16 2019
This release was deployed on Test Apr 17 2019
This release was deployed on Prod Apr 24 2019

  • celery v4
  • client v69
  • notification-server v14
  • scan-coordinator v6
  • scan-handler v4
  • tfrs v104

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.3.3

Operational Notes

Dev

Backend

  • Load the following data after tfrs pods are brought down and database migration completed
    ** python manage.py load_ops_data api/fixtures/operational/0005_add_new_compliance_periods.py
    ** python manage.py load_ops_data api/fixtures/operational/0006_add_carbon_intensity_limits.py
    ** python manage.py load_ops_data api/fixtures/operational/0007_add_energy_effectiveness_ratios.py
    ** python manage.py load_ops_data api/fixtures/operational/0008_add_default_carbon_intensities.py
    ** python manage.py load_ops_data api/fixtures/operational/0009_add_energy_densities.py
  • TFRS environment variable CREDIT_CALCULATION_API_ENABLED = True

Frontend

"compliance_reporting.enabled": true,
"credit_calculation_api.enabled": true,
"compliance_reporting.starting_year": 2017

Test

Hold off on Test

Prod

Hold off on Prod

Inlcuded PRs

PR #1065 Fuel code split

As discussed during our sprint planning, we're going to separate the fuel code into three parts

  • Added migration to separate the fuel code, version and minor version
  • Added auto-complete functionality to show the next available version
  • Added test for the auto-complete functionality
  • Auto-complete functionality automatically removes non-numeric characters
  • Fixed sorting so that the minor version is counted as separate, instead of as a decimal

PR #1067 Credit Trade Optimizations and User Table State Key

Some technical debt that's fairly easy to deal with

  • Reduced the max digits for credit trade so it's not unnecessarily big
  • Made the state key for the users table a bit different so that it's not clashing when you hit back

PR #1072 Carbon Intensity Limits

Created the model, permission, viewset and serializer

  • Added migration for Carbon Intensity Limit
  • Added Model for Carbon Intensity Limit
  • Added Serializer
  • Added front-end code

PR #1076 Energy Effectiveness Ratio Models and stuff

I patterned this very similarly to how Carbon Intensity Limits was created

  • Migration
  • Model
  • Serializer
  • Viewset
  • Front-end

PR #1093 Energy densities and Carbon Intensities

Created the model, viewsets, serializers and tests

  • Added Energy Density Model
  • Added Carbon Intensity Model
  • Added serializers
  • Added viewsets
  • Added tests

PR #1074 Updated the BCeID manual

New manual for BCeID.
I also added a check for the Settings page for Notifications. It now checks if the person has a permission to even few file submissions, before showing any options.

PR #1090 Wire up backend for carbon intensity limits

Backend for carbon intensity limits now hooked up (using demo of new generic action template)

PR #1097 Fuel types

Created the front-end and mock up some data for the Fuel Types

  • Added the table for the fuel types
  • Created sample data

Database Migration

  • 0101_auto_20190329_2115.py //PR #1065
  • 0102_auto_20190401_2109.py //PR #1065
  • 0103_auto_20190402_2318.py //PR #1067
  • 0104_auto_20190403_1616.py //PR #1072
  • 0105_add_credit_calculation_permissions.py //PR #1072
  • 0106_add_fuel_classes.py //PR #1072
  • 0107_auto_20190404_1942.py //PR #1076
  • 0108_auto_20190408_2311.py //PR #1093
  • 0109_auto_20190409_2101.py // PR #1094
  • 0110_add_credit_calculation_fuel_types.py // PR #1094

PR #1068 Setup a new Jenkins for pr based pipeline

PR #1072 Carbon Intensity Limits and PR #1090 Wire up backend for carbon intensity limits and PR #1094 Compliance Reporting

PR #1076 Energy Effectiveness Ratio Models and stuff and PR #1090 Wire up backend for carbon intensity limits

PR #1093 Energy densities and Carbon Intensities and PR #1094 Compliance Reporting

PR #1097 Fuel types

Technical Information

This release was deployed on Dev Apr 10 2019
This release was deployed on Test Apr 11 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.3.2

Pull Requests

PR #1049 Fuel Code Form Label Changes

Adjusted some labels and some validations for Fuel Code

  • Added application date as a required field to save draft
  • Changed the check the array length for transport modes
  • Facility nameplate is now a required field
  • Fixed an overlap issue with the tooltip
  • Adjust fuel code form labels
  • Changed the ordering for Approved fuels to alphabetical
  • Fuel Code is now restricted to numbers and decimals
  • Carbon Intensity is restricted to 2 decimals
  • Commas are automatically added to Nameplate capacity

PR #1051 Jest updates

This is to allow jest to do better snapshot testing with our components so we can increase our coverage.
I was running into errors before because of how it didn't know how to handle imports.
I was trying to get the onclick test to work, but was not successful. It couldn't find it in the instance, so I left that out for now.

PR #1050 Add basic config for PR based pipeline

Add the basic config for a PR based pipeline. This work is based on the WIP sample provided by BCDevOps

PR #1053 Removed the open box icon

The rows are clickable, and the box open isn't clear on what kind of action it'll do. So we opt to just get rid of it.

  • Removed open box column
  • Removed magnifying glass (it was just for display anyway

PR #1055 Added a check in both front-end and back-end for the expiry and effective dates

Added an additional validation to make sure that the expiry date is always after the effective date.

  • Added a front-end check to make sure the expiry date is after the effective date
  • Added a back-end check to make sure the expiry date is after the effective date when creating or updating

PR #1057 Reordered the columns so it's following the table

Changed the order of the columns
Adjusted labels to match the table view

PR #1059 Highlight Scan Failed

Added highlighting for rows that have failing status. I also noticed the highlighting wasn't working as well like before, so I fixed it.

  • Added highlighting to Security Scan Failed
  • Updated the css for the old highlighting to increase its priority

PR #1061 Increased the phone number length to 50 characters

Updated the model to allow 50 characters for the phone numbers
Created a migration to increase the phone numbers

PR #1062 Devops pipeline timeout

Increase timeout for deployment and scaling

Database Migration

0100_auto_20190329_1942.py //PR #1061

Implemented Trello Cards

PR #1049 Fuel Code Form Label Changes

PR #1053 Removed the open box icon

PR #1055 Added a check in both front-end and back-end for the expiry and effective dates

PR #1057 Reordered the columns so it's following the table

PR #1059 Highlight Scan Failed

PR #1061 Increased the phone number length to 50 characters

Technical information

This release was deployed on Dev Apr 1 2019
This release was deployed on Test Apr 2 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.3.1

Operational Notes

A new setting for the front-end credit_transfer.enabled: true. Please add this to DEV and TEST, but not in PROD

PR #1043 Container Fluid for Footer

A quick fix for Container Fluid for Footer.

PR #1038 Added migration to add natural gas-based gasoline

New migration to add an approved fuel type

PR #1036 Notification Settings Update

Notification settings for Secure File Submission will now only show up if the feature is enabled
Some Notification settings for Credit Transfer only show up when the new config credit_transfer.enabled is set to true

PR #1041 Autocomplete css

Some styling for the autocomplete to make it more obvious that its a drop-down.
Reverted the user history tables to use React Table as it seems to be running into an issue.
Generic error handler so we don't get shown just a white screen upon encountering an unrecoverable error

PR #1044 Visual representation fluid

After the update to make the containers "fluid" it kind of messed up the visual representation of Credit Transfers. It wasn't too bad, but also not the prettiest.
This is to update it so it looks a bit better (much more evenly spaced out and not too long boxes)

  • Removed unnecessary divs
  • Removed unused css attributes
  • Used grid system a bit better so that it resizes much more gracefully

PR #1042 Devops parallel pipeline

Add parallel build to ippeline and merge frontend pipeline and backend pipeline into one pipeline.

Database Migrations

  • 0099_add_approved_fuel.py //PR #1038

Implemented Trello Cards

PR #1043 Container Fluid for Footer

PR #1038 Added migration to add natural gas-based gasoline

PR #1036 Notification Settings Update

PR #1044 Visual representation fluid

Technical Information

This release was deployed on Dev Mar 27 2019
This release was deployed on Test Mar 28 2019
This release was deployed on Prod Apr 1 2019

  • celery version 3
  • client version 68
  • notification-server version 13
  • scan-coordinator version 5
  • scan-handler version 3
  • tfrs version 102

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.3.0 Secure File Submission

Operation steps

Make sure the user profile hotfix is included when deploy to prod.

Included Pull Requests

PR #1018 Fuel Code List Enhancements

Content should take up most of the space

  • Changed container to use container-fluid
  • Fuel Code list now has all columns shown
  • Code cleanup for css
  • Adjust look for IE only message
  • Changed confirmation message for update
  • Changed notification message for update
  • Added migration to rename submitted to approved

PR #1020 Save state of ReactTable components in the React Store

Preserve table state (page size, page number, sort, and filter) in the react store so it survives routes changes

PR #1023 Changed the validation slightly so that it has a different check with…

Added Draft Validation

  • Split the validation messages into two, for drafts and approval

PR #1027 Fuel code delete

Allow deletion of fuel code drafts

  • Modified serializer to allow destroy
  • Added deleteFuelCode action in the front-end
  • Added button, confirmation and alert to the front-end
  • Added tests

PR #1028 XLS download for fuel codes

Excel export/download for fuel codes table

PR #1027 Fuel code delete

Allow deletion of fuel code drafts

  • Modified serializer to allow destroy
  • Added deleteFuelCode action in the front-end
  • Added button, confirmation and alert to the front-end
  • Added tests

PR #1031 Backlog Fixes

Drop-down for Fuel Supplier in Create user is now scrollable
Fixed phone numbers not being saved upon create

PR #1033 Fixed tooltip message overlapping on the button, causing it to flash

Follow-up PR. While the validation worked, there was another layer of validation that was on top of the disable button.

  • Removed html validation for saving draft
  • Made adjustments to the tooltip so it doesn't overlap on the button and causes it to flash back and forth

PR #1034 Frontend Optimizations

Facility Location is now autocomplete-enabled
Notifications will once again live-reload (but only if you're on the notifications page)
Autocomplete cache invalidation on certain actions keeps autocompleted recommendations fresh

PR #1032 Fixed an issue where the condition is misplaced

Database Migration

  • 0098_rename_fuel_status_submitted

Implemented Trello Cards

PR #1018 Fuel Code List Enhancements

PR #1020 Save state of ReactTable components in the React Store

PR #1023 Changed the validation slightly so that it has a different check with…

PR #1027 Fuel code delete

PR #1028 XLS download for fuel codes

PR #1027 Fuel code delete

PR #1031 Backlog Fixes

PR #1033 Fixed tooltip message overlapping on the button, causing it to flash

Technical Information

This release was deployed on dev Mar 22 2019.
This release was deployed on test Mar 26 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.17

Operational Notes

Add front-end config

  • keycloak.custom_login: true

Release Details

PR #944 SFS Status transitions

'Draft' SFS with file attachments no longer become 'submitted' automatically
Rename confusing FSDoc migration to GovDoc to keep with naming convention

PR #951 Transport mode and approved fuel selection

Adding fuel and feedstock transportation modes and a list of approved fuels to fuel code creation page

PR #954 Government reviewers can still add comments on received submissions

Updated the flow so Government reviewers can still add comments on received submissions.
Also, updated the error message when trying to rescind a submission that's been received.

  • Changed so that we check with the backend, instead of the front-end on whether to show the comment buttons
  • Updated the check in the permission so that it checks whether the status is in the allowed statuses, instead of checking whether the status is forbidden
  • During validation, we no longer check for the status directly. Instead, we check if the user is authorized to make that change (which checks the status internally)

PR #958 Changed error messages so they're more user friendly

Updated some error messages and removed some of the notification settings that are not needed for government users

  • Changed error message for creating a user when organization is not selected
  • Changed error message for needing to provide a TRIM record # when archiving
  • Added filter for notification settings for SFS

PR #960 Notifications will no longer be sent to inactive users.

Added a check so that notifications are no longer sent to inactive users.

  • Added a check so that recipients that are inactive are no longer sent notifications
  • Did some code clean up as well

PR #945 Should now allow multiple accounts to use the same email

Users are now allowed to have multiple accounts with the same email address (As long as their BCEID and IDIR are unique)

  • Changed keycloak_email in user_creation_request to be non-unique
  • Added external_username to user_creation_request
  • New unique constraint is exernal_username + keycloak_email
  • Changed some names and ids in the front-end
  • Updated the security scan to handle test cases
  • Updated tests
  • Added external username field in the front-end

PR #950 Added a custom login form for TFRS

Added a customized login form that can be enabled/disabled via config.
@kuanfandevops There will be a front-end config that needs to be added in for when this goes in dev, test and prod
keycloak.custom_login: true

  • Added login page
  • Added config to toggle between default redirect or custom login
    Unfortunately, I can't get the login form to work unless we do some token and fetching and enable some settings in keycloak. I think the best compromise is to just use a config

PR #966 Disable Submit and Archive until the required fields are filled in

Added front-end validation for archiving and submitting a file submission

  • Updated tooltip to allow arrays
  • Submit and Archive are both disabled until the required fields are filled in.
  • Added auto-ellipsis for File upload progress

PR #968 Removed the extra api at the end

I misread what BASE_URL will do. So now it's adding /api at the end. This PR should fix that by just finding out where the user currently is.

PR #947 Security Scan Failed Submissions are now editable

I noticed that we can't see the Edit button when the submission has Security Scan Failed.
Also, eslint was complaining with the code so I had to address those.

PR #970 Adjust unit test

Adjust the way to call unit test in pipeline.

Database Migrations

  • 0091_rename_fsdoc_role
  • 0092_auto_20190305_0417
  • 0093_initial_transport_modes_and_approved_fuels
  • 0094_auto_20190305_2356
  • 0095_auto_20190301_1659

Implemented Trello Cards

PR #944 SFS Status transitions

PR #951 Transport mode and approved fuel selection

PR #954 Government reviewers can still add comments on received submissions

PR #958 Changed error messages so they're more user friendly

PR #960 Notifications will no longer be sent to inactive users.

PR #945 Should now allow multiple accounts to use the same email

PR #950 Added a custom login form for TFRS and #947 Security Scan Failed Submissions are now editable

PR #966 Disable Submit and Archive until the required fields are filled in

Technical Information

This release was deployed on dev Mar 6 2019.
This release was deployed on test Mar 7 2019.
This release was deployed on prod Mar 14 2019.

  • client 66
  • scan-coordinator 4
  • scan-handler 2
  • tfrs 101
  • celery 2
  • notification server 11

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - User Profile Hotfix

This hotfix is from branch user-profile-hotfix which is based on v1.2.17

This hotfix release is frontend only. It was deployed on prod Mar 21 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.19

Operation steps

Make sure the user profile hotfix is included when deploy to prod.

Pull Requests

PR #987 Minor UI Enhancements and new Unit Tests

  • Fixed autocomplete unit test (fixture needed an update)
  • Added a unit test to make sure that fuel suppliers can't get access to the linkable credit transactions for secure file submission
  • Added some minor UI enhancements for the labels for linked credit transactions and secure file submissions
  • Fixed an issue with the archive validation crashing the page, if you fill in the input fields in a non-consecutive order
  • Added the organization name in the SFS detail page. Only IDIR users can see this.

PR #992 Submit notification is now sent to government users

Submitted Secure File Submissions Notifications should be sent to government users now

  • Changed to use the helper function to send the notifications
  • Additional check for files that are marked failed

PR #994 Changed icon for the comment privacy setting. Changed to use tooltips

Changed the icons as requested.

  • Lock icon changed to eye
  • Tooltip added

PR #997 Secure File Submission Fixes

Some fixes relating to statuses not updating as expected.

  • Fixed an issue where uploading new files on a submission that's in draft doesn't upload the files
  • Added Upload Progress bar on Edit
  • Allow submitting a submission that has a Security Failed Scan status
  • Added validation to prevent users from submitting submission that contain attachments that have failed or in progress
  • Security Scan Handler now takes into account files that have been removed (and should no longer cause submissions to get stuck in a status)
  • eslint fixes on some files

PR #1004 Fuel code ui changes

Label changes to help the user understand the format for the input fields when adding a fuel code

  • Label changes
  • Added a blank default for fuel
  • Forced lower case when doing autocomplete
    Note: I'm still running into some issues with the autocomplete even with the enforce lowercase. After a couple more trials, it might be a caching issue as it doesn't seem to detect the new company until after you close and re-open the browser.

PR #1008 Fuel code edit

Added Detail and Edit views and functionality

  • Added View Container
  • Added Edit Container
  • Added appropriate reducers
  • Added validation when saving a draft or when adding

PR #1014 Fix component-reload on session continuation

Don't trigger authentication on USER_FOUND if already authenticated

PR #998 Fixed User Activity

PR #989 Add Nagios templates and configuration

PR #1009 Added gratitude for BrowserStack support.

PR #1011 Pipeline database backup

PR #1019 Fixed unit test

PR #1021 Add maintenance page to pipeline

PR #1015 Removed the extra ]

Implemented Trello Cards

PR #987 Minor UI Enhancements and new Unit Tests

PR #992 Submit notification is now sent to government users

PR #994 Changed icon for the comment privacy setting. Changed to use tooltips

PR #997 Secure File Submission Fixes

PR #1004 Fuel code ui changes

PR #1008 Fuel code edit

PR #1014 Fix component-reload on session continuation

Technical Information

This release was deployed on dev Mar 15 2019.
This release was deployed on test Mar 21 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.18

Operation steps

Login to Postgresql and run command "create extension pg_trgm;"
Verify the Operation Notes at v1.2.16 if the two variables can be set to true.
Make sure the user profile hotfix is included when deploy to prod.

Included PRs

PR #971 Fixed tests

It was missing a tab for some reason. So adding it back should fix the failing tests'

PR #961 Autocomplete

  • Five fields on the fuel code creation page are now autocompleted with server-side values per Trello card 942
  • IMPORTANT Postgresql needs postgresql-contrib extension pg_trgm installed and available or migration 96 will fail (this is similar to what was needed for the hstore extension and may require permissions changes or a manual intervention to create the extension)
  • dded environment variable FIX_BROKEN_SQLITE, which if set to True, will allow Django 1.11 to work with versions of Sqlite >= 3.26

PR #977 Fix milestone evidence missing and Link Credit Transactions

Did some minor layout cleanup, and restricted the credit transactions shown in Link Credit Transactions to related credit transactions only

  • Fixed milestone becoming overwritten after it's been received
  • Link Credit Transactions now only show records that involved the fuel supplier
  • Updated layout for consistency
  • Moved Link Credit Transactions table into a modal window to provide more context to the user
  • Code cleanup

PR #984 Linked File Submissions UI Updated

Updated the layout in Credit Transaction details so it shows the linked file submissions in the same way as the one in File Submission

  • Updated Credit Transaction Detail page
  • Replaced Last updated to Submitted on in File Submission List
  • Added timestamp besides status in File Submission detail

PR #978 Added a clause to catch all kinds of error for handling security scans

We're running into an exception that we can't seem to catch. Adding a generic catcher so we know what kind of error it is.

PR #979 Devops pipeline update

Add scan handler and celery to develop pipeline.

PR #972 Fixed the migration conflicts

Database Migration

  • 0096_add_trgm_extension
  • 0097_add_autocomplete_indices

Implemented Trello Cards

PR #961 Autocomplete

PR #977 Fix milestone evidence missing and Link Credit Transactions

PR #984 Linked File Submissions UI Updated

Technical Information

This release was deployed on dev Mar 13 2019.
This release was deployed on test Mar 15 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.16

Operational Notes

Notifications-server pod needs KEYCLOAK_CERTS_URL environment defined (to match Django)
The changes to the config. those need to go in openshift. both front end and back end need them.

  • frontend config map: 'fuel_codes.enabled': true true for dev only, false for test and prod)
  • backend environment variable: FUEL_CODES_API_ENABLED=(true for dev only, false for test and prod)

This release includes

PR #926 Link PVR to Secure File Submission

  • Establish/remove links between credit transfers and secure file submissions

PR #927 Fixed broken functional tests

Fixed the broken functional tests

PR #929 Scanning progress

Added scan progress in the list view.
So for status, instead of "Pending Submission", it shows your scan progress, instead.

PR #930 Per-User Socket.IO channels

  • This card addresses a long-standing technical debt issue. Previously, there was a single global socket.io channel and when notifications were triggered, a reload notice would distributed to all connected users.
  • This PR introduces authentication to the socket.io channel, including full JWT verification
  • notifications are now sent to specific user channels
  • Now that this channel is secure, it could easily be extended to include things like, for example, clamav scan results in realtime
  • The docker environment is suitably updated.
  • IMPORTANT the notifications-server pod will need KEYCLOAK_CERTS_URL environment defined (to match Django)

PR #935 Fuel code create

Basic add Fuel Code should now work.

  • new config for backend
  • new config for frontend
  • new migrations
  • List view for Fuel Codes
  • Add Fuel code
  • Unit test for list and add
    Please note of the changes to the config. those need to go in openshift. both front end and back end need them.
    /bot-ignore-length

PR #937 Updated documentation files

Not sure what to review here, other than that the files load properly.
But ya, new documentation files.

PR #943 Fixed migrations

This should fix the migrations that are running into issues.

PR #942 Add effective and expiration dates to fuel code status

Follow-up PR to add effective and expiration dates to the fuel code status table.

PR #936 Renamed secure_document_submission components

Technical debt: Renamed some files and components to better match their functions

PR #930 Notifications | Per-user socket.io channels

PR #931 Maintenance Screen

PR #932 update maintenance page

PR #933 Update typo and remove a script don't need

PR #946 Add reminder of db backup

Database Migrations

  • 0081_auto_20190220_0014
  • 0082_document_link_permissions
  • 0083_fuelcode
  • 0084_fuelcodestatus
  • 0085_add_fuel_code_statuses
  • 0086_fuelcode_status
  • 0087_add_fuel_code_permissions
  • 0088_auto_20190228_1911
  • 0089_auto_20190228_2106
  • 0090_fuel_code_status_set_effective_dates

Implemented Trello Cards

PR #926 Link PVR to Secure File Submission

PR #931 Maintenance Screen

PR #927 Fixed broken functional tests

PR #931 Maintenance Screen and #932 update maintenance page

PR #935 Fuel code create

PR #930 Notifications | Per-user socket.io channels

PR #937 Updated documentation files

Technical Information

This release was deployed on dev Feb 22 2019
This release was deployed on test Mar 01 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.15

This release Includes

PR #907 Upload progress bars

  • add live progress bars for file uploads

PR #899 File submission archive

Added archive function for government users

  • Archive can only be used after it's been received.
  • Archive changes status to archived.
  • TRIM must be provided before archiving works

PR #902 Prevent comments on Received/Archived Submissions

Comments are no longer allowed for received or archived submissions

  • Buttons for adding comments no longer show up on certain statuses
  • Receiving a submission sends a notification

PR #916 Adjusted notification setting UX

  • In-app now called 'Enabled'
  • Selecting email will enable a notification
  • Disabling a notification type will disable the corresponding email notification
  • Notification preferences are now respected by the backend (disabling works)

PR #917 Add TRIM record for archived submissions

Add TRIM record number in place of security scan status for archived document submissions

PR #915 Hide Pending Submissions

Hide pending document submissions from government users

PR #918 Category changed to Title in SFS list

Change 'Category' to 'Title' in SFS list
The format is {title}: {milestone} for Part 3 Evidence submissions, {title} otherwise

PR #919 Update SFS Validation Messages

Update SFS validation messages

PR #921 User First and Last name required

  • First and Last name are required when creating or editing users
  • Error message for blank email phrasing adjusted

PR #922 Secure File Submission Unit Tests

Finally got the chance to write the unit tests for Secure File Submission

  • Minor code cleanup
  • New tests for Secure File Submission
  • New tests for commenting on Secure File Submission

PR #923 Removing Redundant columns in Credit Trade History

Removed is_internal_record, note, update_user and update_timestamp

  • is_internal_record seems to be an old column that's no longer being used
  • note has migrated to the comments table
  • update_user and update_timestamp columns are redundant as they will never change from create_user and create_timestamp
    @devops before we apply this to prod. can we do a backup of our tables first? this will make changes that are irreversible

PR #925 Admin tabs should be viewable for all government users

Changed the permission check into a check whether the user is government or not.

PR #928 Devops backup

Add database backup container

Database Migrations

  • 0076_add_document_status_archived
  • 0077_auto_20190211_1930
  • 0078_auto_20190211_2127
  • 0079_auto_20190219_1859
  • 0080_remove_credittrade_note

Implemented Trello Cards

PR #907 Upload progress bars

PR #899 File submission archive

PR #902 Prevent comments on Received/Archived Submissions

PR #915 Hide Pending Submissions

PR #916 Adjusted notification setting UX

PR #917 Add TRIM record for archived submissions

PR #918 Category changed to Title in SFS list

PR #919 Update SFS Validation Messages

PR #921 User First and Last name required

PR #922 Secure File Submission Unit Tests

PR #923 Removing Redundant columns in Credit Trade History

PR #925 Admin tabs should be viewable for all government users

Technical Information

This release was deployed on dev Feb 15, 2019
This release was deployed on test Feb 21, 2019
This release was deployed on test Feb 27, 2019

  • notification-server-10
  • client-64
  • celery-1
  • scan-handler-1
  • scan-coordinator-3
  • tfrs-99

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.14

PR #896 Performance optimizations

Fix to address the issues encountered in PR #889

  • Added in-database caching for notification_subscriptions
  • Added hints for credit_trade list to prefetch certain fields
  • Added a count-only endpoint for notifications and shifted notification fetching into the NotificationContainer

PR #877 Document Rescind

Added rescind functionality for Secure File Submissions.

  • Added rescind functionality (revert to draft) for submissions, pending submissions
  • Updated confirmation message before submission
  • Code cleanup
  • Validation for Milestone should now be included as part of the initial check for titles and compliance period

PR #903 Add Middleware to detect IE and add no-cache headers

Possible workaround for IE caching 'features'

PR #904 Devops scancoordinator

PR #893 Add scan handler config for supervisord

PR #905 revise celery and scan-handler config

PR #906 Add scan handler and celery to pipeline

Operational Scripts

  • python manage.py createcachetable MUST be run post-migration for the cache to work, possibly as part of the mid-deploy in the buildconfig (it is important like migrate)
  • Create scan-handler and celery deployment config. And have them up and running at the environment.

Database Migration

  • 0075_remove_document_rescinded_status.py //PR #877

Implemented Trello Cards

PR #877 Document Rescind

PR #903 Add Middleware to detect IE and add no-cache headers

Technical Information

Deployed on dev Feb 12 2019.
Deployed on test Feb 13 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.13

This release includes:

Fix dev #890

ReactTable is updated to version 6.9.0.
Lock some versions in so we don't encounter issues like this.

Added help files for bceid and IDIR users #895

Added Help file for both bceid and IDIR users.

Technical Information

Deployed on dev and test Feb 7 2019
Deployed on prod Feb 7 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.12

PR #869 Startup service checks

Added a startup hook for the Django app to validate external service dependencies (Minio, Email, Keycloak, and AMQP) to validate configuration on startup and exit abnormally if a check fails.
Corresponding changes to docker-compose environment

PR #870 Celery-based orphan cleanup

Added celery dependency for flexible scheduled tasks
Added minio orphan cleanup task
Some devops work is required to support the celery execution. I'm recommending we use supervisord as I've done in the docker installation to handle this in the openshift environments.

PR #881 Added metatag to force IE to use latest rendering method

IE (even IE11) seems to be rendering the site using IE7 mode. This is causing the site not to load anything. So we have to force it to use whatever latest version it has.

PR #879 Mostly code clean up. And added a redirect onError in AuthCallback

I've been trying to figure out what the issue is.
It seems like CallbackComponent might be getting called earlier than expected? Not 100% sure, but the idea of the redirect in the error function in AuthCallback is to try and get the state again. To get to that point, the user should be already authentication. The issue is that the state didn't seem to get updated.

PR #880 fix for testing in openshift environment

Detect testing environment and skip startup checks

PR #882 Changed how the check goes and only run the checks when running servers

Instead of checking if we're running the test, we check if we're running the server.
The reason for this is for functions like migrate and collectstatic.

PR #872 Fixed wrong redirect issue when creating a user

Fixed an issue where creating a fuel supplier user as a government user, redirects the user into /admin

  • Added a check to see what the url is when the user was being created

PR #884 Add scan coordinator to pipeline

Add scan coordinator build and deploy to pipeline

PR #885 Adjust hash for scan coordinator build image

PR #886 update hash for test prod pipeline

Database Migrartion

  • Applying django_celery_beat.0001_initial... OK
  • Applying django_celery_beat.0002_auto_20161118_0346... OK
  • Applying django_celery_beat.0003_auto_20161209_0049... OK
  • Applying django_celery_beat.0004_auto_20170221_0000... OK
  • Applying django_celery_beat.0005_add_solarschedule_events_choices_squashed_0009_merge_20181012_1416... OK
  • Applying django_celery_beat.0006_periodictask_priority... OK

Operartional Scripts

  • v1.2.12_operation_notes.txt

Implemented Trello Cards

PR #870 Celery-based orphan cleanup

PR #881 Added metatag to force IE to use latest rendering method

PR #879 Mostly code clean up. And added a redirect onError in AuthCallback

PR #872 Fixed wrong redirect issue when creating a user

Technical Information

Deployed on dev and test Feb 6 2019.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.11 Credit Trade Hotfix

PR #874 Credit Trade Hotfix

Seems like there's a bug in the caching if no organization has been updated.
One of the digest requires an updated_timestamp from the organizations table. The problem is if no organization has ever been updated then it'll run into a hard error.

Technical Information

This release was deployed on test and prod on Jan 31 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.10 Secure Document Validation

This release includes:

PR #862 bc and dc for Clamav

OpenShift build config and deployment config files for Clamav

PR #867 Secure Document Validation

Added validation and delete functions for Secure File Submission

  • Added validation for title and compliance period
  • Delete draft should now work
  • Fixed an issue with auto-mapping when logging in the first time (email no longer case sensitive)

Database Migration

  • 0073_auto_20190128_2014.py //PR #867
  • 0074_add_document_statuses.py //PR #867

Operational Script

  • Follow the instruction in openshift/templates/scan-coordinator/create-scan-coordinator.sh //the script is located at v1.2.12

Implemented Trello Cards

PR #867 Secure Document Validation

Technical Information

  • Deployed on Dev Jan 30 2019
  • Deployed on Test Jan 30 2019
  • Deployed on Prod Jan 31 2019
    client - #61
    tfrs - 95
    notification-server - #6

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 6 years ago

Transportation Fuels Reporting System - v1.2.9

This release includes

PR #844 Icons to report security scan status

  • Change upload toast to 'Document uploaded' (was 'Document submitted').
  • Icons for file upload status on upload detail view
  • Report submission status on upload detail view

PR #845 Notifications count flashing fix

Track notification count in the state of Navbar to avoid flashing a null value while it updates

PR #846 Secure document upload edit

Edit functionality implemented.

  • Allow removal of older files
  • Able to edit the fields

PR #850 Validation permission clean up

Did some code cleanup to improved validation error messages and db comments

  • Removed View Compliance Period permission
  • Updated db comments
  • Updated validation error messages for User Creation
  • Renamed Credit Retirement to Credit Reduction

PR #858 Secure File Submission Updates

UI changes relating to Document Upload to File Submission.

  • Changed Document Upload to File Submission
  • Enabled comments for other attachment types
  • Page Title should now update depending on the type
  • Changed Fuel Supply Records to Compliance Reporting Materials
  • Change attachment type from button group to drop-down
  • Added related_document field to Notification
  • Notification for documents should now redirect to the view detail page for documents
  • Removed draft permission from FSDoc

PR #860 Caching and Logout optimizations

  • Leverage the Django low-level caching API to cache verification API keys for 10 minutes in-memory. This results in a huge performance gain.
  • Remove some vestiges of the old logout code

Database Migrations

  • 0066_documentfileattachment_is_removed.py
  • 0067_permissions_remove_view_compliance_periods.py
  • 0068_rename_fuel_supply_records.py
  • 0069_remove_documenthistory_user_role.py
  • 0070_rename_credit_retirement.py
  • 0071_rename_document_upload.py
  • 0072_notificationmessage_related_document.py

Implemented Trello Cards

PR #844 Icons to report security scan status

PR #845 Notifications count flashing fix

PR #846 Secure document upload edit

PR #850 Validation permission clean up

PR #858 Secure File Submission Updates

Technical Infomration

Deployed on Dev Jan 23 2019
Deployed on Test Jan 24 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.8 Document Security Scan

This release includes

PR #826 Security scan

  • Implement clamAV security scan
  • Requires some new deployment configurations, to follow shortly
  • Docker configuration works (requires appropriate minio.env)

PR #828 Document upload commenting

Added commenting for Secure Document Upload
Removed comment column from the document table

  • Added document_comments table
  • Added the comment forms (replicated from Credit Trade comments)
  • Added submit button when viewing drafts
  • Some pylint code cleanup

PR #829 Caching Update

  • Include the name of the most-recently-modified organization in Etag configuration for credit transfer caching to fix stale data issue
  • Simplify nginx configuration for faster startup (remove some vestiges of Siteminder dependency)
  • Added FSDoc role to docker-environment test users
  • FSDoc and FSDocSubmit roles now have VIEW_COMPLIANCE_PERIODS permission via migration. Necessary for secure doc upload page to load correctly.

PR #832 Filename restrictions

Verified that long filenames won't cause issues with the system

  • Added automatic ellipsis for long filenames

PR #834 Changed Modal Delete Message for Historical Data Entry

Changed the message so it shows "credit transaction" instead of "credit transfer"

  • Updated the modal delete

PR #837 Document milestone

Added a milestone extension file. It's a bit overkill as it's an extension for one field. If we're not adding any more fields to it. We should fold it into the Document model, instead.

  • Migration to add Document Milestone
  • Migration to Add the record number to Document
  • Updated UI so it shows only the fields related to the attachment type

PR #838 Update document status and send notifications

Change document status to "Pending Submission" when a security scan is in progress, and either "Submitted" or "Security Scan Failed" depending on the result.
Send relevant notifications.
For testing purposes, the EICAR test file can generate a virus-found result:
https://www.eicar.org/?page_id=3950

PR #830 script to load functional test data

PR #835 update openshift templates

PR #839 Fix migration conflicts

PR #840 Fixed the failing tests caused by missing milestones

Operational Scripts

  • Setup Clamav for ech enviroment by following the instructions in Openshift/templates/document-security-scan/create-security-scan.sh
  • 1.2.8_operational_notes.txt

Database Migration

  • 0060_documentcomment.py // PR #828
  • 0061_auto_20190110_2139.py //PR #828
  • 0062_documents_permission_update.py //PR #829
  • 0063_documents_permission_update.py //PR #839
  • 0064_new_document_statuses.py //PR #838
  • 0065_auto_20190114_2347.py //PR #838

Implemented Trello Cards

PR #826 Security scan

PR #828 Document upload commenting

PR #832 Filename restrictions

PR #834 Changed Modal Delete Message for Historical Data Entry

PR #837 Document milestone

PR #838 Update document status and send notifications

Technical Information

The release was deployed on Dev Jan 14 2019
The release was deployed on Test Jan 17 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.7

This release includes

PR #813 Clean up CreditTradeHistory, Remove Siteminder support

Remove deprecated Siteminder support in both frontend and backend
Remove old Siteminder headers from User model

PR #816 Fixed migration conflicts

Fixed the migration conflict and add permission check for Adding comments

  • Renamed migrations
  • Removed BCeID field from user form
  • Added User Creation Request email for UserViewSerializer
  • Created migration for Add Comment
  • Add Comment Permission is now required before it allows the user to add comments

PR #819 Title should now be editable for Users

Title was already in the table as a column. So I just had to update the code a bit so it's updateable

  • Added Title in serializers
  • Updated form to include title
  • Updated details page to include title

PR #821 Added file size validation in the front-end

File size is now restricted to 50 mb (handled by the front-end)

  • UI should now display MB instead of bytes
  • Fixed broken snapshot test (via upgrading components in npm)

PR #824 Fixed failing tests caused by missing file

Removed test_utils from nose.cfg
Fixed an issue that Anton found when viewing users as a government user.

PR #822 Notification Update fix

Isolated fix to make server-triggered notification updates work correctly

PR #825 Update Nginx to remove header add_header X-Frame-Options

Operational scripts:

  • v1.2.7_operational_notes.txt

Database Migration

  • 0057_auto_20190103_2258.py //PR #813
  • 0058_auto_20190103_2258.py // PR #816
  • 0059_comment_permissions.py //PR #816

Implemented Trello Cards

PR #813 Clean up CreditTradeHistory, Remove Siteminder support

PR #816 Fixed migration conflicts

PR #819 Title should now be editable for Users

PR #821 Added file size validation in the front-end

Technical information

Deployed on Dev Jan 8 2019.
Deployed on Test Jan 9 2019.
Deployed on Prod Jan 10 2019.

  • Client prod deployment version 60
  • TFRS prod deployment version 92, (93 is caused by adding new environment variables)
  • Notification-server prod deployment version 5

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.6

This release includes

PR #806 display_name defect resolution

Addresses Trello Card 1079 by providing a fallback in the event of a null or blank display_name

PR #809 Require role assignment

Require a user to be assigned at least one role on creation or update
Trello Card 1080

PR #812 PVR Notification Messages

Should now be more descriptive for PVR messages

  • PVR is now being replace by the credit transaction type

PR #815 Fix users not receiving in-app notifications when a PVR is approved

Fixed the in-app notification not being sent to users when a PVR is approved

  • Added a line to send the notification to users

PR #807 Fix signin redirection issue

PR #810 Fixed migration for PR #806

Database Migrations

  • 0056_auto_20190103_2227.py //PR #810

Implemented Trello Cards

PR #809 Require role assignment

PR #806 display_name defect resolution

PR #812 PVR Notification Messages

PR #815 Fix users not receiving in-app notifications when a PVR is approved

Technical information

Deployed on dev Jan 2 2018
Deployed on test Jan 4 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.5 Secure upload backend

This release includes:

PR #789 Create user when a role is added is now populated

Changed default page size to 10 from 15. Updating a user's role is now being tracked.

  • Updated tables so page size is set to 10
  • Creating/updating a user now update the create_user_id column in the user_roles table

PR #792 Secure upload backend

Branched from Rob's secure-upload-backend branch.

  • Removed create_organization from models (getting it from create_user, instead)
  • Added filename as a column in document_file
  • Changed document type to buttons
  • Created view details
  • Two different Upload URLs for uploading and retrieving the file
  • New Invalid files section
  • New validation function
  • onDrop sorts the files into accepted and rejected files
  • Credit/Edit Organization label changes
  • Edit button in Organization only shows up when its applicable
  • Migration to update permission descriptions
  • Review Button added

Data Migrations

  • 0048_auto_20181213_2313.py //PR #792
  • 0049_auto_20181217_1824.py //PR #792
  • 0050_documentfileattachment_filename.py //PR #792
  • 0051_auto_20181218_1654.py //PR #792
  • 0052_document_data_update.py //PR #792
  • 0053_auto_20181220_1644.py //PR #792
  • 0054_organization_descriptions_update.py //PR #792
  • 0055_role_permission_descriptions.py //PR #792

Implemented Trello Cards

PR #789 Create user when a role is added is now populated

PR #792 Secure upload backend

Technical Information

Deployed on Dev Dec 28 2018
Deployed on Test Jan 2 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.4 Minio setup and defect fixes

This release includes

PR #775 Minio and notification

Openshift configurations for Minio and Notification setup

PR #767 Follow-up Fixes

Found a couple of issues by the previous fix. So this is to fix those.

  • Fixed logout
  • If a user has multiple records of the same role, it should no longer make the checkbox unclickable
    Removed validation from Phones as it's causing confusing behaviour

PR #779 Download as xls fix

Fixed the download button

  • Now using axios to download the file
  • Organization form updated styling

PR #784 New pipeline implementation

This is the start of the third version of pull request based pipeline

PR #790 Update minio to use parameters for the size of PVC

PR #791 Postgresql update dc and notes

Operational Notes

This release requests Minio instance fully setup in Openshift environment.

Database Migration

  • 0047_auto_20181205_1716.py //PR #767

Implemented Trello Cards

PR #767 Follow-up Fixes

PR #779 Download as xls fix

Technical Information

This release was deployed on dev Dec 12 2018
This release was deployed on test Dec 21 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.3 Secure Document Upload Phase 1 and Functional Test Improvement

This release includes

PR #757 Secure document upload

Finished the containers for the front-end.

  • Added containers for Add, Edit, Detail and List
  • Added reducers for the respective containers
  • Front-end placeholder added and will be modified according to the models/backend

PR #771 Updated Placeholder Text for Fair Market Value

Updated the placeholder for Fair Market Value in New Credit Transaction

  • Updated Fair market value placeholder text
  • Fixed session not getting updated with new information like phone number

PR #773 Secure upload backend 1/2

The first of two PRs related to the secure upload backend. Requesting merge so we've got a common starting point for the remaining work.

PR #772 BDD - Version updates

Update BDD build.gradle versions, to match the latest version of the BDD image built by Kuan.
Some other trivial updates.

PR #780 1063 - BDD - Organization Add/Edit Tests

Organization add/edit tests.

  • Test to create a new organization
  • Test to edit the created organization

Update Readme.

  • Initial pass at adding more useful content, especially for someone just starting to get into BDD, and in particular working with Geb.

Other minor updates/renames.

  • Renamed some files/classes to be more accurate.
  • Renamed a few functions to be more clear, nothing major.

As usual, may need minor tweaks if delays that exist only in OpenShift, and not locally, arise.

  • See the section on waiting in the Readme, in particular waitFor{}

PR #781 Improving Test Stability

A wait is added to somme frontend components.

PR #782 Increased delay to avoid clashing

Increase timeout to avoid timing issues

PR #770 Bump ChromeDriver & Selenium versions to absolute latest.

Database Migrations

  • 0045_documents.py //PR #773
  • 0046_document_data_load.py //PR #773

Implemented Trello Cards

PR #771 Updated Placeholder Text for Fair Market Value

PR #780 1063 - BDD - Organization Add/Edit Tests

PR #773 Secure upload backend 1/2 and #757 Secure document upload

There are many Trello Cards will be resolved, stay tuned for part 2.

Technical Information

This release was deployed on dev Dec 12 2018
This release was deployed on test Dec 12 2018
This release was deployed on prod Dec 13 2018. Here are the deployment versions:

  • Client: 59
  • Notification-Server: 4
  • TFRS: 91

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.2 Frontend primary fields and notification fix for functional test

This release includes

PR #761 Fixed Front-end Issues with Primary Fields

The recent changes with the primary fields broke several components. This PR will hopefully fix most of those.

  • Changed how the BCeID, organization, status and roles show up
  • Fixed issues found with the functional tests
  • Added an automatic clean for the double quotes for the functional tests (.env values can't have spaces unless they're enclosed)

PR #766 Fixed notification not refreshing right away

Functional test should pass successfully after this fix.

Implemented Trello Card

PR #761 Fixed Front-end Issues with Primary Fields

Tenical Information

  • This release was deployed on dev Dec 4 2019
  • This release was deployed on test Dec 4 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.1-hotfix update release number to 1.2.1

This release includes

PR #760 update release number to 1.2.1

Technical Infomation

  • This request was deployed on dev Dec 4 2018
  • This request was deployed on test Dec 4 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.1 Redirection Performance Improvement

This release includes

PR #759 Configurable debug and fixed authentication

Changelog
Enabling debug can now be done by setting debug.enabled in config/features.js.
The login redirect is fixed
Upgraded redux-oidc

Deployment Notes

Configmap will need to change, since features.js needs to be updated as follows:
DEV: set debug.enabled: true
TEST and PROD: set debug.enabled: false

Technical Informmation

This release was deploy on dev Dec 3 2019
This release was deploy on test Dec 3 2019

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.2.0 User Management

This release includes

PR #742 Update profile

Allows the user to edit their secondary information through the settings page.

  • Added new tab on Settings page
  • Updated the layout/style for Settings so it's more consistent with the other pages
  • Added a new test tp make sure certain fields are read-only
  • Used PATCH to do the update

PR #744 Automatically set the fuel supplier when adding a user from the Organization Page

You can now add a user from the fuel supplier page and it's automatically set.

  • Add a new route for adding users through the Fuel Supplier page
  • Automatically sets the fuel supplier in the add user page on certain conditions

PR #746 Inactive users can no longer login

Updated the check if the user is inactive for keycloak

PR #747 Update docker/keycloak config to add new tfrsadmin Admin user

Log in as 'tfrsadmin' and it has Admin privileges.

PR #748 Session timeout implementation

Add 10 minute session timeout, per Trello card 645.
Added redux-saga dependency as a way to cleanly track session expiration state

PR #749 1005 - BDD User Add/Edit tests.

Add new user and update existing user tests and general cleanup and updates.

  • Add/update fuel supplier user as fuel supplier admin
  • Add/update fuel supplier user as tfrs admin
  • Add/update admin user as tfrs admin

PR #755 Front-end fixes for Input fields and User edit

Fixed the issue with BCeID labels and added placeholder text for Credit Transactions.

  • Added placeholder text for Quantity of Credits and Fair Market Value
  • BCeID and BCeID Email Address labels should reflect better for Add/Edit User forms
  • Fixed an issue where an error message wouldn't go away for the Add User form
  • Fixed an issue where the Fuel Supplier wasn't populating properly

PR #756 New migration for the notification subscription messages

django was complaining about needing to makemigrations, so here's the generated migration file.

PR #750 Minor fixes

PR #751 Wording change

PR #752 1005 - Minor Fixes

PR #753 1005 - additional tweaks to improve stability of user create/edit tests.

Data Migrations

  • 0044_auto_20181122_2212.py //PR #756

Implemented Trello Cards

PR #742 Update profile

PR #744 Automatically set the fuel supplier when adding a user from the Organization Page

PR #746 Inactive users can no longer login

PR #748 Session timeout implementation

PR #749 1005 - BDD User Add/Edit tests.

PR #755 Front-end fixes for Input fields and User edit

Technical Information

This release was deployed on dev Nov 21 2018.
This release was deployed on test Dec 3 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.1.4 Fuel Supplier Creation

This release includes

PR #730 Fixed the user creation for BCeID by providing a default organization

Fixed issues creating a user as a fuel supplier user.

  • Added automatic fill for organization field when creating a user as a fuel supplier
  • Changed the message Pulled back to Recalled as draft
  • Minor code cleanup

PR #734 Minor CSS Updates

  • Added search icon on the right side of filters
  • Darker borders for input fields
  • Made the resizable headers for tables more visible

PR #735 Signin redirection fix

This PR attempts to fix the signin multiple-redirect issue by removing a superfluous OIDC middleware and adjusting the signin flow to prevent extra redirects.

PR #737 Added back buttons on a couple of detail pages

  • Added back button to detail pages

PR #739 Fuel supplier creation

  • Adds support for adding and editing fuel suppliers
  • Adds a "referenceData" reducer to avoid duplicating database state in constants files

PR #738 Remove invalid import

Implemented Trello Cards

PR #730 Fixed the user creation for BCeID by providing a default organization

PR #734 Minor CSS Updates

PR #737 Added back buttons on a couple of detail pages

PR #739 Fuel supplier creation

Technical Information

This release was deployed on dev Nov 9 2018
This release was deployed on test Nov 15 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.1.3 User Management BETA

This release includes

PR #700 Roles list

Added new tab: Roles for Admin

  • Added a new tab for Roles
  • Roles should be clickable to show permissions
  • Role row is clickable

PR #701 Devops pipeline timeout

Extend pipeline timeout to 30 minutes

PR #702 Roles list updates

Follow-up Pull Request to fix some issues found.

  • Added Tabs in Company Details
  • The import for getRoles had to change since it's no longer the only thing in roleActions
  • Simplified the way to get the organization in Company Details
  • Changed how the Download button looks like in Fuel Suppliers

PR #714 Clickable rows

Made the rows clickable for Credit Transactions, User and User Activity

  • Changed zero reason label
  • Changed file name for Download as .xls
  • Changed the text in Settings
  • Notification Labels have now PVR specific messages
  • Credit Transactions table rows are now clickable
  • User Table rows are now clickable
  • User Activity rows are now clickable
  • Various Fixes

PR #716 Credit Trade Status Fix

Fixed an issue with the Credit Trade Status model

PR #715 User create

  • Added UserCreationRequest model. The function of this model is to bind a Keycloak principal to a TFRS user on first login (by email address).
  • Added authentication logic to create the binding
  • Added /api/users/by_username?username={username} API call to facilitate redirect after user creation
  • Fixed caching issue for CreditTrade list that can occur in rare situations

PR #718 Notification draft status

Pulled back and Returned to Analyst are now possible notifications.

  • Added Pulled Back notification
  • Added Returned to Analyst notification
  • Added conditions to check so the service knows which notification to send when a credit trade is updated.

PR #723 Credit Trade History and User Activity Server-Side Pagination

  • Added server-side pagination for some large tables to reduce load times
  • Moved the state of the table into the relevant react components rather than the store, since the maintenance of this state is local to the corresponding component.

PR #720 Historical data entry notifications

Notifications are now sent out when using the commit function in Historical Data Entry

  • Added notification hook in batch process
  • Related organization should be populated in the Notification Message

PR #724 BDD - Minor Stability Update

  • Minor update to hopefully improve stability based on some odd test failures and subsequent investigation.
  • After running some trials, it looks like there is a rare case where the expected content of a dropdown does * not exist. Possibly due to some rare loading race condition, or having to do with minuscule loading delays between focusing the dropdown, and when the dropdown content renders?
    Adding waits around all dropdown selectors, which in the best case scenario will improve stability; worst case nothing will change.

PR #726 Status change patch

Renamed Credit Trader, simplified the process of changing the status (code-wise). Cleaned up permissions.

  • Created a migration to change Credit Trader to Credit Transfers
  • Changing status uses PATCH instead of PUT now
  • Code cleanup regarding permissions

PR #732 BDD - Updated notification wait logic + minor quality of life improvements

  • Update notification waits.
  • Move assertions from functions back in line, to improve console output if failures occur.

PR #731 Fix history issue when BUILD_NUMBER undefined

PR #697 font awesome icon eye changed to box-open

PR #727 #728 Path based url

PR #691 updated db_comment for fair_market_value_per_credit

PR #721 update timeout of notification server build

PR #703 contributing update for link to trello

Database Migration

  • 0039_usercreationrequest.py // PR #715
  • 0040_auto_20181024_2106.py // PR #715
  • 0041_merge_20181031_2228.py // PR #715
  • 0042_update_credit_trader_role_description.py //PR #726
  • 0043_edit_user_permission_clean_up.py //PR #726

Implemented Trello Cards

PR #700 Roles list

PR #702 Roles list updates

PR #714 Clickable rows

PR #715 User create

PR #723 Credit Trade History and User Activity Server-Side Pagination

PR #720 Historical data entry notifications

PR #726 Status change patch

Technical information

This release was deployed on dev Oct 30 2018
This release was deployed on test Nov 9 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.1.2 User Roles

This release includes

PR #687 Managing Users Role

Updated the permissions for Managing Users role

  • Added the Add User button in Company Details for fuel supplier
  • Added migration to update the description and permission for Managing Users
  • Added read-only Organization for when Fuel Suppliers add users

PR #585 Fix for 1 vulnerable dependencies - npm:debug:20170905

This PR fixes one or more vulnerable packages in the npm dependencies of this project.

PR #679 Hide SMS settings

Hide SMS settings column for demo
Better authentication flow (friendly message) in the case where a user is logged into Keycloak but has no mapped user within TFRS

PR #681 Decline Transaction Changes

Changed the transaction history message for Decline.

  • Fixed an issue with declining
  • Changed the transaction history message for Decline

PR #693 978_MinorTestFix

  • Code Changes
    • Trivial fix for the checkbox logic.
  • Pipeline Update
    • New OpenShift Environment Variables to develop-client-pipeline and functional-test-pipeline
      • SUPPLIER_ONE_ORG=TFRS Fantastic Fuels

PR #692 1006 - add credit balance assertions

  • Add credit balance assertions.
  • Update credit amounts (to ensure all +/- combinations of credits are unique)
  • Other trivial/minor updates.
  • Add .env support to build.gradle (for local testing against docker)
  • Can rename 'example.env' to '.env' and it will be picked up automatically.

PR #696 978_MinorTestFix_2

Add exists() check for .env logic.

PR #695 Different way to disabling snyk

Apparently, prepare is a hook for npm. So that's why it was running it every time.

Database Migrations

  • 0039_update_fs_admin_permissions.py //PR #687

Operational Instruction

New OpenShift Environment Variables to develop-client-pipeline and functional-test-pipeline

  • SUPPLIER_ONE_ORG=TFRS Fantastic Fuels

Implemented Trello cards

PR #687 Managing Users Role

PR #679 Hide SMS settings

PR #681 Decline Transaction Changes

Technical Information

This release was deployed on Dev Oct 26 2018.
This release was deployed on Test Oct 30 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.1.1

This release includes

PR #652 Create user form

Front-end for the create user should be complete. (no back-end submit yet)

  • Form should have all the fields needed for creating a user
  • Roles are loaded from the back-end
  • Autocomplete implemented for Fuel Suppliers
  • Confirmation Alert implemented
  • System Alert implemented
  • Edit icon should now be available
  • Permission is required for the Edit icon to show up
  • New migration to update guest role

PR #664 Django security update

Update Django to 1.11.15 due to potential security vulnerability.

PR #663 Persist destination in localStorage when navigating

  • Added targetPath reducer that watches for redux-oidc action LOAD_USER and preserves current route in state.
  • Added redux-localstorage dependency and modified store configuration to persist the state for reducer targetPath
  • Streamlined configuration of store object
  • Minor adjustments to docker config to make it less verbose

PR #665 Fix the failing tests caused by the changes to permissions

Follow-up PR to fix the failing tests caused by the referenced PR #652

  • Reverted the permissions back to its previous state
  • Added EDIT_FUEL_SUPPLIER_USERS permission

PR #666 Added tests and allow parameter to filter the roles

Made the roles that show up in the create/edit user more dynamic.

  • Roles can be filtered by parameters
  • Added tests

PR #667 Added Keycloak support to the docker-compose image

  • Add support for Keycloak authentication to the docker iamge
  • Pre-populate a test Keycloak realm with users on startup

PR #670 Assign roles permission

Roles in Add/Edit User form should now have tooltips on what kind of permissions the role has.

  • Added tooltip for permissions
  • Remove extra $ from text representation
  • Fix minor eslint issues

PR #671 Emailed Notifications Support

Enable basic support for notification by email

PR #673 Fixed an issue where the a user cannot rescind a recommended transfer

Fixed the issue where a fuel supplier can't rescind a recommended transfer

  • Updated serializer so it simulates a partial update
  • Removed the reliance for front-end translation for roles

PR #674 Token renew

  • Process token silent renewals, preventing session timeout and token expiry.
  • Processing occurs via a callback from keycloak to an iframe
  • Another script bundle was created to facilitate communication between the iframe and redux-oidc for consumption of the renewal events

PR #677 Rename Approved to Record and Completed to Approved

Changed some of the credit trade status labels

  • Added migration
  • Changed Approved to Recorded
  • Changed Completed to Approved
  • When approving a credit transfer, the system no longer creates an approved history
  • Updated tests
  • Changed the colours to follow the government specs

Migrations

  • 0031_role_display_order.py //PR #652
  • 0032_role_rename.py //PR #652
  • 0033_update_admin_permissions.py //PR #652 #665
  • 0034_update_guest_permissions.py //PR #652
  • 0035_add_assign_role_permissions.py //PR #666
  • 0036_update_credit_statuses.py //PR #667
  • 0037_add_deputy_director_role.py //PR #667
  • 0038_credittradehistory_user_role.py //PR #667

The implemented Trello Cards

PR #652 Create user form

PR #666 Added tests and allow parameter to filter the roles

PR #670 Assign roles permission

PR #666 Added tests and allow parameter to filter the roles

PR #671 Emailed Notifications Support

PR #673 Fixed an issue where the a user cannot rescind a recommended transfer

*Trello-967 Credit Transfer | Allow Fuel Supplier Users to Rescind the transfer even when the transfer is recommended

PR #674 Token renew

PR #677 Rename Approved to Record and Completed to Approved

Technical Infomration

This release was deployed on Dev Oct 22 2018
This release was deployed on Test Oct 22 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.1.0 Notification

This release includes

PR #643 Various front-end fixes that were caught during the sprint review

Some bugs were found during sprint review. This PR is to fix them.

  • Explanatory comment validation
  • Number of credits validation message
  • New Input component with tooltip
  • Organization that refused the credit transfer should have their name properly displayed

PR #646 Mark Notifications as Read on Click

Automatically mark the notification as read upon click.

  • Changed to
  • Added updateNotification call to button

PR #653 changed the icon for archive notification and undo award

Migrations and Scripts

N/A

Trello Cards Implemented

PR #643 Various front-end fixes that were caught during the sprint review

PR #646 Mark Notifications as Read on Click

PR #653 changed the icon for archive notification and undo award

Technical Information

This release was deployed on Dev Oct 4, 2018.
This release was deployed on Test Oct 5, 2018.
This release was deployed on Prod Oct 22, 2018. Keycloak has not been integrated yet. The operational scripts in "v1.0.12 Keycloak Integration" have NOT been applied on Prod.
The operational scripts in "v1.0.12 Keycloak Integration" was applied on Prod Nov 15 2018.
The deployment numbers were:

  • client:57
  • notification-server:1
  • tfrs:88

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.12 Keycloak Integration

This release includes

PR #642 Keycloak

Complete keycloak/JWT implementation, co-existing with Siteminder for now.
Set environment KEYCLOAK_ENABLED for both node and django to preview the functionality. The docker- compose.yml gives a good overview about how to set it up.
Keycloak user attribute user_id is mapped to django User.username by the new authentication middleware.

PR #648 Externalized Configuration

Externalize feature configuration to a file, public/features/config.js to support OpenShift configMap deployment-time environment customisation via file injection.
This can't be accomplished via environment variables in our current deployment configurations since the application is built only once and deployed in several environments, served as a static bundle.

PR #654 Update Keycloak configurations

Update Openshift templates to include Keycloak configuration

PR #655 BDDStack keycloack integration changes.

Update for latest keycloak/headless considerations.
Current condition of tests (specifically, running against keycloak-dev in headless mode):

  • Issue with React not redirecting to the previous page after authenticating on page load (Rob investigating). Workflow tests Ignored for now.
  • Issue with the Contact Us footer link. Seems to have an issue similar to the above redirect weirdness. Test commented out for now.
  • Issue testing links that direct to PDFs specifically in headless mode. Tests commented out for now. (Low priority)

PR #661 Pipeline modification to include functional test

Operational Scripts

v1.0.12_Keycloak_Ingreation.txt
v1.0.12_dev_features.js //for dev
v1.0.12_test_features.js //for test
v1.0.12_prod_features.js //for prod

Implemented Trello Cards

Technical Information

This release is deployed on Dev Oct 3 2018.
This release is deployed on Test Oct 5 2018.
This release was deployed on Prod Oct 22, 2018 with v1.1.0. but the operation scripts have NOT been applied on Prod yet. They should be done once prod Keycloak SSO is setup by lab.
The operation scripts were applied on prod Nov 15, 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.11

This release includes

PR #630 No-Cache for Notifications

Added a never_cache decorator for IE as it seems to be running into caching issues

  • Added never_cache decorator to list()

PR #632 Negative values are no longer allowed for Fair Market Value Input

Negative symbol is no longer allowed in the FairMarketValueInput

  • Prevent keypress of -
  • Paste should also detect if there's a - in the clipboard
  • Tooltip should be shown notifying the user negative values are not allowed

PR #634 Increase the width of some columns for the download spreadsheet

Increased the width of the columns for the spreadsheet so they show the full value without needing the user to manually adjust it.

Database Migrations and Scripts

N/A

Implemented Trello Cards

PR #630 No-Cache for Notifications

PR #632 Negative values are no longer allowed for Fair Market Value Input

PR #634 Increase the width of some columns for the download spreadsheet

Techical Information

This release has been deployed on Dev and Test Sep 26, 2018.
This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.10 Functional test

This release introduced a set of functional tests based on current TFRS implementation

PR #625 BDD Test Uplift + Initial Workflow/Flow tests.

Added spec for flow tests.

  • Includes basic minimal set of tests for header/footer links.
  • Can decide to expand these, or toss them if we don't want to test links in general.
    Added spec for credit transfer scenario.
    They fill every field, including comments.
  • Currently they only assert on the notification badge count.
  • Need to determine what additional assertions to add, if any.
  • Added more IDs to UI elements for use in functional tests.
    Added CodeNarc to build a report of linting errors.
  • Fixed majority of issues, in particular all of the 'priority' issues.
  • Need to continue to tweak the rules (or remove some rules).

PR #638 Updates to better support OpenShift environment variables

  • Updates to better support OpenShift environment variables.
  • Trivial fix for real check box selector.

PR #641 update podtemplate

Updated the functional test pipeline

Implemented Trello cards

PR #625 BDD Test Uplift + Initial Workflow/Flow tests.

Technical Information

This release has been deployed on Dev and Test Sep 26, 2018.
This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.9 message, permission change and adding notification build to pipeline

This release includes:

PR #623 Changed the message for Zero-Dollar Reason validation

Change the validation message for Zero-Dollar when no reason has been selected.

  • Changed the message for zero-dollar reason validation

PR #627 Show only one "Return" button when user has both analyst and director role

Added condition to only show one button for returning the status to draft if the user has both analyst and director role.

  • Added a check if Pull Back was already included

PR #628 Devops pipeline notification

Add notification server build to pipeline

Database migrations and scripts

N/A

Implemented Trello Cards

PR #623 Changed the message for Zero-Dollar Reason validation

PR #627 Show only one "Return" button when user has both analyst and director role

Technical Information

  • This release has been deployed on dev Sep 24 2018
  • This release has been deployed on test Sep 25 2018
    This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.8 Maintenance Release - RabbitMQ and Notification server setup

This release is a maintenance release including operational process to create RabbitMQ and Notification server.

PR #635 templates cleanup, reorganize and add notification server templates

Operational Process

RabbitMQ and Notification ServerSetup

  • Create secrete rabbitmq according to the environment. It is used by Notification server to connect to RabbitMQ
  • Run command:
Dev:
oc process -f ./create-notification.withprameters.json -p \
ENV=dev \
NOTIFICATION_SERVER_IMAGE_NAME=notification-server-develop \
PROJECT_NAME_SPACE=mem-tfrs-dev \
TFRS_INTERNAL_HOST_NAME=dev-lowcarbonfuels.pathfinder.bcgov \
| oc create -f -
Test:
oc process -f ./create-notification.withprameters.json -p \
ENV=test \
NOTIFICATION_SERVER_IMAGE_NAME=notification-server \
PROJECT_NAME_SPACE=mem-tfrs-test \
TFRS_INTERNAL_HOST_NAME=test-lowcarbonfuels.pathfinder.bcgov \
| oc create -f -
Prod:
oc process -f ./create-notification.withprameters.json -p \
ENV=prod \
NOTIFICATION_SERVER_IMAGE_NAME=notification-server \
PROJECT_NAME_SPACE=mem-tfrs-prod \
TFRS_INTERNAL_HOST_NAME=prod-lowcarbonfuels.pathfinder.bcgov \
| oc create -f -

Add following environment variables to tfrs deployment configuration and roll it out.

projectname is one of mem-tfrs-dev, mem-tfrs-test and mem-tfrs-prod

{
	"name": "RABBITMQ_USER",
	"value": "tfrs"
},
{
	"name": "RABBITMQ_VHOST",
	"value": "/tfrs"
},
{
	"name": "RABBITMQ_HOST",
	"value": "rabbit.<projectname>.svc"
},
{
	"name": "RABBITMQ_PASSWORD",
	"valueFrom": {
		"secretKeyRef": {
			"name": "rabbitmq",
			"key": "password"
		}
	}
}

Run the export script to update Openshift templates

Technical Information

  • The script has been run on dev Sep 21 2018
  • The script has been run on test Sep 24 2018
  • This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.7 Path based URL

This release includes

PR #621 Path Based URL for New Pipeline

We can now mount the application in a "subfolder".
Please make sure to update the .env file appropriately. This is shared between front-end and back-end.
.env should be in the project root folder (not in backend or frontend).
Here's a sample content:
BASE_PATH=/pr-1

  • New package for NPM to allow reading of .env
  • New package for django to allow reading of .env
  • Updated wsgi to make the variable work

Database migration and srcipts

N/A

Implemented Trello Cards

PR #621 Path Based URL for New Pipeline

Technical Information

  • This release was deployed on Dev Sep 21, 2018
  • This release was deployed on Test Sep 21, 2018
  • This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - V1.0.6 Fair market value decimals

This release includes

PR #624 Standalone Socket.IO server functionality

For integration with Openshift for notifications

PR #618 Fair market value decimals

Updated validation messages to be more user-friendly

  • New FairMarketInputValue component
  • Limits decimal places to 2
  • Prevents multiple dots (.)
  • Shows tooltip when adding more than 2 decimals
  • Changed generic error messages from the back-end to have more details
  • Removed front-end validation to check that number of credit trades is a whole number
  • Added a check to the back-end to validate that the number of credit trades is a whole number

Database migration and scripts

N/A

Implemented Trello cards

Technical Information

  • This release was deployed on Dev Sep 20, 2018
  • This release was deployed on Test Sep 20, 2018
    This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.5 Maintenance Release

This release includes:

PR #619 Auto-generated the migration so we sync properly

Django is complaining about unapplied migrations. So let's create this to ensure that we sync properly and not run into problems where the server has a different migration sequence than ours.

Database Scripts

  • 0030_auto_20180919_2145.py from PR #619

Technical information

This release was deployed on Dev Sep 29 2018
This release was deployed on Test Sep 29 2018
This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.4 UX updates and compliance period upon approval

This release includes

PR #604 Ux updates

Various front-end changes

  • Credit Transactions -> credit transactions
  • Removed timestamp from xls filename
  • Remove progress bar from toastrs
  • Changed some of the success messages for toastrs
  • Minor text changes
  • Fixed a bug with checkboxes in Notifications

PR #612 UX Further Updates

Further changes to the front-end

  • Updated Zero-dollar reason validation message
  • Updated text for zero-dollar reason
  • Removed additional warning message when declining
  • Signing History should no longer show multiple "recommended" entries
  • Additional text added when a transaction is rescinded, refused or declined

PR #614 Add Compliance Period upon Approval

Credit transactions that don't have compliance period when they get approved should now automatically get a compliance period.

  • Added a check and to automatically add a compliance period upon approval
  • Added test fixture for compliance periods
  • Added test

PR #594 Added a new migration to change 'Of' to lowercase

Just a new migration to change "Of" to "of"

  • Test fixtures updated
  • Migration added

Database Migrations

Data Migration

  • 0029_government_of_bc_rename.py //from PR #594

Implemented Trello cards

PR #604 Ux updates

PR #612 UX Further Updates

PR #614 Add Compliance Period upon Approval

PR #594 Added a new migration to change 'Of' to lowercase

Technical information

This release was deployed on Dev Sep 18 2018
This release was deployed on Test Sep 18 2018
This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - V1.0.3 Notification

This release includes:

PR #574 Notifications API

  • This PR encompasses the notifications API and support for communication between frontend and backend via AMQP for the relay of notifications.
  • The docker-compose environment has been updated to support the AMQP server and new node dependencies and should be rebuilt to include new proxy configuration. This can be accomplished with docker-compose down --rmi all -v && docker-compose up.
  • Successful deployment of this PR depends on the existence of a RabbitMQ server within the application environment, with environment variables passed into both the python and node services.
  • ex:
    • RABBITMQ_VHOST=/tfrs
    • RABBITMQ_USER=guest
    • RABBITMQ_PASSWORD=guest
    • RABBITMQ_HOST=rabbit
    • RABBITMQ_PORT=5672

PR #580 Add OpenShift templates

Backend, frontend, database and SchemaSpy templates are added to repo.

PR #581 Mock AMQP in unit tests

Address an issue with unit tests failing within the pipeline

PR #582 create new OpenShift templates

OpenShift templates are re-generated and added to TFRS repo

PR #577 Change DB Comment Generation for Foreign Keys

Modify Foreign-key automated commenting

PR #584 made interface updates to the Credit Transfer page

Credit Transfer frontend updates

PR #586 [Snyk] Fix for 1 vulnerable dependencies - npm:ms:20170412

Fixes one or more vulnerable packages in the npm dependencies of this project.

PR #587 Notifications integration

Connected the Back-end code to the Front-end

  • Notification page should now have the checkboxes working
  • Notification icon should now work
  • Added Button with dropdown
  • Subscription should now load the statuses of the checkboxes based on the user's preference
  • Saving should work and should have an alert

PR #595 v1.0.0 hotfix

Add prod pipeline to deploy v1.0.0 to prod.

PR #605 Create new templates for prod pipeline

New build and new prod pipeline

Database Migrations and Scripts

Migrations

  • 0026_notificationchannel_notificationmessage_notificationsubscription.py //from PR #574
  • 0027_auto_20180827_1414.py //from PR #574
  • 0028_notificationmessage_is_archived.py //from PR #587

Scripts

N/A

Implemented Trello Cards

PR #574 Notifications API

PR #584 made interface updates to the Credit Transfer page

PR #587 Notifications integration

Technical Information

This release was deployed on Dev Sep 12, 2018
This release was deployed on Test Sep 18, 2018
This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.2 Frontend update, docker live editing and SchemaSpy updates

This release includes

PR #573 Devops pipeline schemaspy audit

Update pipeline to use newly create schema spy deployment config

PR #567 Docker Live Editing

  • docker-compose'd environments now support live-editing with automatic hot-reload for both frontend and backend code
  • webpack updated to version 4, and configurations adjusted for compatibility
  • nginx reverse proxy passes websockets correctly
  • recommend rebuilding existing docker environments with docker-compose down --rmi all -v && docker-compose up

PR #572 Front end updates

Updated some of the node packages. Text Improvements. Validation for Number of Credits

  • Number of Credits with decimals are now rejected with a display message. Previously it would just automatically round it
  • Download as speadsheet has been shortened
  • Updated FontAwesome library to include more icons
  • Can now trigger error messages in the front-end

Data Migrations, fixtures and scripts

Data Migrations

N/A

Fixtures

N/A

Scripts

N/A

Operational scripts

N/A

Implemented Trello cards

PR #573 Devops pipeline schemaspy audit

PR #572 Front end updates

Technical information

PR #573 and #567 were deployed on Dev August 31, 2018
PR #572 was deployed on Dev September 5, 2018
All PRs were deployed on Test September 5, 2018
This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.1

This release includes

PR #546 Notification service

Added the settings page (front-end only)

  • Added Settings in the User's dropdown menu
  • Added Notifications icon
  • Settings menu will go to the appropriate page that lets the user choose which notifications are available to them
  • Notifications icon goes to a blank page for now
  • Save in the Notifications page prepares the data to submit, but doesn't really submit yet.
    FontAwesome css updated.

PR #547 Enable docker-compose support for local dev environment

To facilitate ease of environment setup for new developers. No Trello card.

PR #549 Enable zero-reason rationale requirement for 'buy' type transfers

Adjust frontend components to support zero-reason rationales for 'buy' type trades.

PR #550 Adjust layout of credit transfer

Alter the layout of the credit transfer view and forms to match Trello card 755

PR #554 Front-end Fixes

  • Added an updated css for FontAwesome
  • Added reducers (Currently just a preparation)
  • Added sample notifications temporarily
  • Some text fixes that were missed from the last pull request

PR #560 updated db_comment for respondent

A more verbose and plain language description of columns and foreign keys

PR #561 Interface language

Language changes

PR #562 adjust timeout to 600 from 120 seconds

Adjust timeout

PR #565 update release number to v1.0.0

Release number update

PR #566 JS Duplicate Fix

Fix an issue with the pipeline and a form to crash.

Data Migrations, fixtures and scripts

Data Migrations

N/A

Fixtures

N/A

Scripts

N/A

Operational scripts

N/A

Implemented Trello cards

PR #546 Notification service

PR #549 Enable zero-reason rationale requirement for 'buy' type transfers

PR #550 Adjust layout of credit transfer

PR #554 Front-end Fixes

PR #561 Interface language

Technical information

PR #546 and #547 were deployed on Dev Aug 29, 2018
PR #549, #550, #554, #560, #561, #562, #565 and #566 were deployed on Dev Aug 31, 2018
All PRs were deployed on Test Aug 31, 2018.
This release was deployed on Prod Oct 22, 2018 with v1.1.0.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v1.0.0

This tag is same as v0.3.1.17.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v0.3.1.17 Historical entry note public, user history types and arrow direction in credit transfer view

This minor release includes

PR #536 Historical entry note public

"notes" are no longer internal comments.

  • Changed comments automatically added by historical data entry to be external
  • Minor code changes to satisfy pep8
  • Credit Transaction notes now look more like the commenting system allowing the user to pick between internal or public comment

PR #540 User History Types

Update the types for the user activity so it uses the front-end language instead.

  • Used the getCreditTransferType function to get the front-end description for credit types

PR #537 Adjust arrow direction in credit transfer view

Arrow direction in credit transfer visual representation now depends on transfer specifics.

Data Migrations, fixtures and scripts

Data Migrations

N/A

Fixtures

N/A

Scripts

Operational scripts

  • v0.3.1.17_new_account_1 //run on dev, test and prod
  • v0.3.1.17_new_account_2 . //run on dev and test
  • v0.3.1.17_update_inactive_fuel_suppliers.py //run on dev, test and prod
  • v.0.3.1.17_remove_tfrs_biz_test.py //run in test and dev, verified through staging

Implemented Trello Cards

PR #536 Historical entry note public

PR #540 User History Types

PR #537 Adjust arrow direction in credit transfer view

Technical information

PR #536 and #540 were deployed on Dev Aug 22, 2018
PR #537 was deployed on Dev Aug 23, 2018
All three PRs were deployed on Test Aug 23, 2018
v0.3.1.17_new_account_1 was loaded on Dev and Test Aug 29, 2018. It was loaded on Prod September 13, 2018.
v0.3.1.17_new_account_2 was loaded on Dev and Test Aug 29, 2018
v0.3.1.17_update_inactive_fuel_suppliers.py was loaded on De, Test Aug 29, 2018 prod September 13, 2018.
Prod Deployment: client:55, tfrs:84, postgresql:13

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v0.3.1.16 Transfers visibility and defect fix

This minor release includes

PR #527 Reviewed Transfers Visibility

Changed how the visibility of recommended and not recommended transactions work

  • Recommended/Not Recommended PVRs are no longer visible to non-government users
  • Recommended/Not Recommended Credit Transfers are no longer shown as reviewed, but as "Accepted"
  • Added tests to verify the changes.

PR #534 Added a fix so that the fields are repopulated with the ones in the form

Added a fix for the repopulation bug

  • Added submitted flag to see if the user has submitted the form
  • Submitted flag will check whether the fields should be populated by the current state or the original state

Data Migrations, fixtures and scripts

Data Migrations

N/A

Fixtures

N/A

Scripts

N/A

Implemented Trello Cards

PR #527 Reviewed Transfers Visibility

PR #534 Added a fix so that the fields are repopulated with the ones in the form

Technical information

All PRs were deployed on Dev August 20, 2018.
All PRs were deployed on Test August 21, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v0.3.1.15 Defect fix

This minor release includes

PR #524 Fixed a typo blocking bypass functionality on modal errors

  • Fixes issue identified in Trello card 764

PR #525 Change director decline warning

  • Per Trello card 765 the messaging for directors choosing to decline a credit transfer proposal is now much more verbose.

PR #528 Fixed an issue with comments crashing the Add PVR page

  • Fix for frontend adding PVR crashing issue

PR #531 Follow up fixes

  • Removed unused (old) JSX files
  • Added friendly_name for CreditTradeStatus
  • Added friendly_name for CreditTradeType
  • Changed the status and type displayed in the spreadsheet to use the friendly names
  • Allow toastr to have custom messages
  • Changed toastr message when a Government Director returns a transfer to draft.

PR #532 Not Found

Defect fix for not found page in frontend.

Data Migrations, fixtures and scripts

Data Migrations

N/A

Fixtures

N/A

Scripts

N/A

Implemented Trello Cards

PR #524 Fixed a typo blocking bypass functionality on modal errors

PR #525 Change director decline warning

PR #531 Follow up fixes

Technical information

All PRs were deployed on Dev August 17, 2018.
All PRs were deployed on Test August 17, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v0.3.1.14 Zero-dollar-per-credit trade and prevent government users from seeing refused transfers

This minor release includes

PR #519 Change phrasing of a modal alert

PR #520 Prevent government users from seeing refused transfers

  • Prevent government users from seeing transfers in status "Refused".

PR #462 Require a rationale for a proposed zero-dollar-per-credit trade

  • Created a test case to evaluate proposing a trade with 0 fairMarketValuePerCredit validation
  • Extended UI to include a choice of rationale for a zero-valued "Sell"
  • Require a comment when selecting reason "Other"

PR #518 Bug fixes

  • New fixture to add a separate "Use Historical Data Entry" feature
  • Backend now has restriction to prevent non-government users from performing actions on PVR records
  • Removed ID column from fuel suppliers front-end
  • Quantity in Credit Transfer Proposal now has commas

Data Migrations, fixtures and scripts

Data Migrations

  • 0025_historical_data_entry_permissions.py

Fixtures

N/A

Scripts

  • role_permissions_cleanup.py // run on Test, confirm from developers before running on prod (did run on prod)

Implemented Trello Cards

PR #519 Change phrasing of a modal alert

PR #520 Prevent government users from seeing refused transfers

PR #462 Require a rationale for a proposed zero-dollar-per-credit trade

PR #518 Bug fixes

Technical information

All PRs were deployed on Dev August 15, 2018
All PRs were deployed on Test August 15, 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v0.3.1.13 Export, system alerts and create/update credit trade and create comment

This minor release includes

PR #496 Export as Spreadsheet for Credit Transfers and Fuel Suppliers and PR

  • Created SpreadSheet Builder service
  • Added Download as Spreadsheet button to Credit Transactions
  • Added Download as Spreadsheet button to Fuel Suppliers

PR #513 System Alerts

Implemented a toastr system to provide feedback to the user when they perform certain actions.

  • Installed Redux Toastr
  • Fixed an issue where a credit transfer initiated by a government user crashes when editing
  • Added highlighting of newly added/updated row
  • URL is rewritten when loading the Credit Transaction List page (this is to solve an issue I had with the highlight function)

PR #497 Create or update credit trade and create comment concurrently

  • Added 'comment' field to credit_trade POST and PUT and updated serializer to insert comment records
  • Added relevant tests

PR #521 Permission Fixed

  • gradlew files marked executable

Data Migrations, fixtures and scripts

Data Migrations

N/A

Fixtures

N/A

Scripts

N/A

Implemented Trello Cards

PR #496 Export as Spreadsheet for Credit Transfers and Fuel Suppliers and PR

PR #513 System Alerts

PR #497 Create or update credit trade and create comment concurrently

Technical information

  • All PRs was deployed on Dev August 15, 2018.
  • All PRs was deployed on Test August 15, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v0.3.1.12 Inactive user can't login, government analyst pull back and added user tab

This minor release includes

PR #488 Users that are marked as inactive can no longer login

  • Additional check on authentication.py so inactive users can't login

PR #490 Government analyst pull back

  • Only applicable to PVR
  • Checks for the rescind permission
  • Is named "Pull Back"

PR #492 Added Users Tab in Admin

  • Cleaned up routes.js
  • Merged the routes for Credit Transaction History, Historical Data Admin into Admin.js
  • Added user routes into admin.js
  • Added another route for the UserDetailsContainer

Data Migrations, fixtures and scripts

Data Migrations

N/A

Fixtures

N/A

Scripts

  • v0.3.1.12_remove_abbreviation_from_fuel_suppliers.py
    Notes: the script has no dependency with this release, but it needs 0024_ops_data_tables.py migration completed. the command is: python manage.py load_ops_data ./api/scripts/v0.3.1.12_remove_abbreviation_from_fuel_suppliers.py

Implemented Trello Cards

PR #488 Users that are marked as inactive can no longer login

PR #490 Government analyst pull back

PR #492 Added Users Tab in Admin

Technical information

All Three PRs were deployed on Dev August 8, 2018.
All Three PRs were deployed on Test August 8, 2018.
All Three PRs were deployed on Prod August 14, 2018.
Prod Deployment Versions: TFRS:83 Client:54 Postgresql:13

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v0.3.1.11 Externalize Operational Data

This minor release includes

PR #468 Externalize Operational Data

  • fixtures directory separated into operational and test categories
  • test data is used by test cases exclusively
  • `operational' data is used in dev, test, and production environments
  • confidential data should not be committed to git, but can be stored in api/fixtures/confidential for local use
  • Prodlike roles removed (and their permissions assigned to GovUser and GovDirector)
  • Core data moved to migration 0023 from fixtures. This migration should be safe to run even on non-empty databases. If in doubt, take a backup. It is not reversible.
  • Future core data changes (adding permissions, for example) that are not specific to the BC implementation and do not contain confidential information should be deployed via migrations so that they are versioned and reversible.
  • A new Django management command, load_ops_data created. The command executes special operational scripts within the Django environment and logs their outcome to new table data_load_operations. This command can load the file either from the local system like python manage.py load_ops_data some_file_name.py or from Minio like python manage.py load_ops_data --minio --minio-bucket opsdata some_file_name.py (in which case the environment variables MINIO_ACCESS_KEY, MINIO_SECRET_KEY, and MINIO_ENDPOINT must be set)
  • Two classes created, in api/management for data loading scripts to subclass -- OperationalDataScript is a generic abstract base class for complex operations and DataLoader is an implementation for loading lists of simple objects (in a similar way to fixtures, but reversible and tracked).

Data Migrations, fixtures and scripts

A full database backup is needed before deploying this release to Test and Prod.

Data Migrations

  • 0023_core_data_load.py
  • 0024_ops_data_tables.py

Fixtures

N/A

Scripts

N/A

Implemented Trello Cards

Technical information

PR #468 was deployed on Dev at Aug 07, 2018.
PR #468 was deployed on Test at Aug 08, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v0.3.1.10 Detail view for organization and new credit transaction for part 3 award validations and reductions

This minor release includes

PR #467 Added detail view for organization

Organization Detail should now be viewable for IDIR Users.

  • Created MyOrganizationContainer to differentiate from OrganizationViewContainer
  • Updated OrganizationViewContainer to allow organization ID to be passed
  • Added an endpoint to the backend for viewing organizations

PR #480 Add credit transaction

Added "New Credit Transaction" for Government Users

  • Renamed Propose Trade to New Transfer
  • Added New Credit Transaction for government users (this is in place of New Transfer)
  • New form for PVR
  • Used the same Add Container for the new form and all form for Credit Transfers
  • Used the same Edit Container for the new form and all form for Credit Transfers

Data Migrations, fixtures and scripts

There is no dependency between the fixture and script. Both fixture and script need to run on Test and Prod.

Data Migrations

N/A

Fixtures

  • roles_permissions_pvr.json //new fixture file

Scripts

  • role_permissions_cleanup.py //updated script, re-run it
  • update_inactive_fuel_suppliers.py //this script needs to run but it has NO dependency on this release and not on GIT

Implemented Trello Cards

PR #467 Added detail view for organization

PR #480 Add credit transaction

Technical information

  • PR #467 was deployed on Dev at July 27, 2018
  • PR #480 was deployed on Dev at August 7, 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops over 6 years ago

Transportation Fuels Reporting System - v0.3.1.9 Replaced notes in Historical Data Admin and Auditing for Critical Tables

This minor release includes

PR #465 Replaced notes in Historical Data Admin with comments

Replaced notes with comments in Historical Data Entry

  • Replaced notes with a single entry comment field (cannot add more than 1 comment)
  • Clean up actionTypes and reducerTypes constants
  • Updated tests
  • Removed some unused files

PR #464 Auditing for Critical Tables

  • Created a new migration operation AuditTable which accepts a table name and enables auditing on that table.
  • All actions logged in detail to tfrs_audit.logged_actions
  • Migrations are reversible.
  • Migrations are NO-OP for SQLITE/MySQL
  • Setup triggers and an audit table that log all actions modifying data for the tables specified.
  • Requires HSTORE extension to Postgres, which is included with Postgres but requires superuser permission to enable. Recommend creating it manually on dev, test, and prod. eg:
  • CREATE EXTENSION HSTORE;. This only needs to be done once.
  • For developmental testing with Postgresql, since Django creates and drops the database, I recommend assigning superuser to the role used by your dev environment.

Data Migrations, fixtures and scripts

Data Migrations

PR #464

  • 0021_audit_triggers.py
  • 0022_audit_tables.py

Fixtures

N/A

Scripts

PR #464

  • Login postgresql terminal and run following command before migration is pipeline is started. They need to run on all three environment.
    • create extension hstore;
    • grant create on database tfrs to "user-on-env" //for Dev, Test and Prod, the user is different

v0.3.1.9_addroles.py this is no PR associated

  • Run this script stored at shared project space. The script has been run on dev and test based on release v0.3.1.9. It as been run on prod based on release v0.3.1.6. All are at July 26, 2018

Implemented Trello Cards

PR #465

Trello-725 Historical Data Entry | Replace Notes field with Comments

PR #464

Trello-731 Auditing | Audit changes to certain tables using database triggers

Technical information

All PRs have been deployed on Dev and Test at July 26, 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.3.1.8 Recommended/Not Recommended, multiple roles for user and permission cleanup

This minor release includes

PR #457 Recommended/Not Recommended should show up as Reviewed for non-government users

Recommended and Not Recommended should no longer show up in the api request and just show up as 'Reviewed'

  • Status is now overridden in the serializer and forced to show "Reviewed" with a "Recommended" ID (regardless whether it was really recommended or not)

PR #456 Allow Multiple Roles for Users

You should now be able to assign multiple roles to a user without the app breaking.

  • user now has a new property called 'roles' instead of 'role'
  • Merged UserMinSerializer and MemberSerializer together (They looked too similar)
  • RoleSerializer no longer loads permissions
  • Merged RoleSerializer and RoleMinSerializer (other than one loads permissions. they're very similar)
  • User now has a permissions property (to avoid duplicate permissions through multiple roles)
  • The check to see if the user is a government user has been moved from the role and into the user as a property called 'isGovernmentUser'
  • Added helper function in the front-end to get the role name
  • Added test for the helper function

PR #463 Allow Multiple Roles for Users

Follow-up PR to fix the failing test found in #456

PR #461 We now have a script to clean up the permission from Roles

We now have a script to clean up the permission from Roles

  • Added a simple script to remove specific permissions from GovUser
  • Added a simple script to remove specific permissions from GovAdmin

Data Migrations, fixtures and scripts

Data Migrations

N/A

Fixtures

N/A

Scripts

PR #461 We now have a script to clean up the permission from Roles

  • role_permissions_cleanup.py (run for all three environment)
  • update_effective_dates.py (NOT to run for any environment)

Implemented Trello Cards

PR #457 Recommended/Not Recommended should show up as Reviewed for non-government users

PR #456 Allow Multiple Roles for Users

PR #461 We now have a script to clean up the permission from Roles

Technical information

All PRs are deployed on Dev at July 24, 2018.
All PRs are deployed on Test at July 24, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.3.1.7 Government user history and comments Editing

This minor release includes

PR #440 Government user history

Added user activity in the Admin tab.

  • Added User Activity
  • Added additional tabs for Admin
  • User Activity for government covers all users for the government as opposed to just one person

PR #448 Script to import existing notes as comments

Simply Django shell script to import existing notes as comments (and set the notes to null in preparation to drop the field).
Optionally takes a parameter of a fallback user id to use as the comment creator when the creator of a credit trade is indeterminate (probably should be set to the id of a government analyst).

PR #447 Comments Editing

  • Added permissions and comments to enable editing by the comment creator until the credit trade status changes
  • Update UI to enable commenting
  • Built a backend test suite for evaluating credit trade status changes

Data Migrations, fixtures and scripts

Data Migrations

  • 0020_credittradecomment_trade_history_at_creation.py

Fixtures

N/A

Scripts

  • import_existing_notes_as_comments.py (PR #448), parameter is needed according to different environment.

Implemented Trello Cards

PR #440 Government user history

PR #447 Comments Editing

Technical information

All three pull requests are deployed on Dev at July 19, 2018
All three pull requests are deployed on Test at July 20, 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.3.1.6 Database schema comments, active class on navigation link and fuel supplier addresse

This minor release includes

PR #437 Database Schema Comments

  • Added a post-migration hook to the application to populate database comments
  • Added comments for all fields and tables
  • Created a mechanism to allow straightforward inclusion of future comments as part of field definitions.
  • Created mechanisms to allow documenting fields indirectly used (including those from abstract parent classes and Django itself)

PR #441 Python 3.5 Pipeline fix

  • Fixes tests when running under Python 3.5 (also works on 3.7).

PR #443 Added active class on the current navigation link

Navigation should now mark where you are now. Ran into some issues with react not updating the component unless you do a full browser refresh. So had to add a pure: false on the NavBar component. Ideally, we change this later on

  • Changed Link to NavLink in NavBar
  • NavLink should have "active" class if it matches the route

PR #444 Fix migration rollback issue

Fixed a defect in database schema commenting where rolling back a pre-existing migration could result in uncaught exceptions.

PR #446 Fuel suppliers addresses

  • Added Address to Company Details
  • Added OrganizationAddress Model
  • Added Serializer for OrganizationAddress
  • Autoloaded OrganizationAddress from OrganizationSerializer
  • Added Address to the front-end

Data Migrations and Fixtures

The included Data Migrations

  • 0019_organizationaddress.py (from PR #446)

The Fixtures loaded

  • organization_addresses.json (from PR #446)

Implemented Trello Cards

PR #437 Database Schema Comments

PR #443 Added active class on the current navigation link

PR #446 Fuel suppliers addresses

Technical information

PR #437 and #441 are deployed on Dev at July 17, 2018.
PR #443, #444 and #446 are deployed on Dev at July 18, 2018.
All five PRs have been deployed on Test at July 18, 2018.
All five PRs have been deployed on Prod at July 19, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.3.1.5 Signing history, improved testing and security updates

This minor release includes

PR #432 Enable frontend unit testing coverage reporting

  • Enables code coverage as part of npm test run.
  • No Trello card for this one.

PR #431 Security regression

This pull request creates tests for and addresses security issues discovered during the security audit.
Compliments to @amichard for security fixes, particularly with respect to credit trade status changes.

  • Legacy APIs and their routes removed
  • Exhaustive tests of every possible credit trade status change for validity
  • All tests reworked into common framework (and Pylint score significantly improved)
  • Test that respondents cannot modify credit trade details
  • Test HTTP Method access control for endpoints /organizations, /compliance_periods, and /users added

PR #436 Signing history

Added the User Activity into the company details tab.

  • Added Link to View User
  • Added history into View User screen
  • Removed some unused code

Data Migrations and Fixtures

The included Data Migrations

N/A

The Fixtures loaded

  • roles_permissions_v0.3.1.json

Implemented Trello Cards

PR #431 Security regression

PR #436 Signing history

Technical information

PR #432 and #431 are deployed on Dev at July 11, 2018
PR #436 is deployed on Dev at July 12, 2018.
All three PRs are deployed on Test at July 12, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.3.1.4 Company Details and Transaction History

This minor release includes

PR #417 Credit Trade Signing HistoryMinor fix to fuel supplier commenting

  • Block access to Sign 1/2 button when commenting mode is active

PR #425 Tweaks and fixes for the frontend

This should fix a lot of the frontend issues we've encountered during the demo. And one fix on the backend.

  • Fixed backend issue throwing a permission error when rescinding
  • Renamed Cancel to Back
  • Signing History should be hidden when no one has signed it (applicable to old proposals)
  • Updated the tooltip for Sign 2/2
  • Reviewed and Recommended line in Signing History is now hidden from Fuel Supplier users
  • Version number at the bottom should now link to latest release in github

PR #419 Added Company Details tab

Company Details Tab is now available for non-government users. I created new serializers to avoid exposing more than necessary information to fuel suppliers.

  • Added new tab for Company Details
  • Company Details should contain some information, credit balance and list of users
  • Added mine and member in viewsets so we don't have to fetch the organization ID first

PR #430 Transaction History

This updates the history so it covers more status changes, like if it was rescinded or refused.

  • Renamed get_reviewed to get_history
  • get_history now returns a list from a single object
  • Signatures are now used for verification instead of a separate call
  • Changed the format of the entries

Data Migrations and Fixtures

The included Data Migrations

N/A

The Fixtures loaded

N/A

Implemented Trello Cards

PR #417 Credit Trade Signing HistoryMinor fix to fuel supplier commenting

PR #425 Tweaks and fixes for the frontend

PR #419 Added Company Details tab

PR #430 Transaction History

Technical information

This release is deployed on Dev at July 5, 2018 and July 9, 2018.
This release is deployed on Test at July 9, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.3.1.3 Credit trade signing history and commenting for fuel suppliers

This minor release includes

PR #413 Credit Trade Signing History

We should now have a section in the Credit Trade where it shows who signed the proposal and who reviewed the proposal.

  • Added CreditTradeSigningHistory component
  • Added signatures and reviewed property in the Credit Trade
  • Restored the single quotes in CreditTradeHistory (was getting into an infinite loop if I try to import CreditTradeHistory into CreditTrade)
  • Removed Propose Trade permission from Government Director

PR #414 Add commenting for fuel suppliers

This pull request introduces the commenting feature for fuel suppliers.

  • Added natural key lookups for User, Role, Permission, Credit Trade Status, and Type to ease test fixture creation
  • Exhaustive testing suite to validate permissions are applied as specified by business logic
  • Created a new test fixture with more production-like government roles to test finer-grained permissions
  • Refactored commenting permissions to allow client and server to share the same logic (the server passes allowable commenting actions as part of a credit trade API response)
  • Tooltips/disabled statuses for action buttons when commenting mode is active

Data Migration and Fixture

The following migrations are included:

  • 0016_rename_comment.py
  • 0017_auto_20180628_2024.py
  • 0018_auto_20180703_1718.py

The fixture loaded is

  • roles_permissions.json (notes: one record is removed from this file, this is the reason why this file is listed here. The record has been removed from Test database manually.)

Implemented Trello Cards

Technical information

This release is deployed on Dev at June 29, 2018(PR#413 only) and July 03, 2018, deployed on test at July 03, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.3.1.2 - Buy Sell Validation

This minor release includes

  • Added a check when trying to sell more than the available credits for your organization. Buying should be unrestricted still, but accepting a proposal that will reduce your credits to less than what's available will also be declined
    • Can no longer save a draft or propose to sell with quantity more than available credits
    • Can no longer accept a buy proposal that will reduce credits more than available
    • Created BaseTestClass
    • Moved some tests into tests folder

Data Migration and Fixture

The following migrations are included:

  • 0015_auto_20180625_1543.py

The fixture loaded is

N/A

Implemented Trello Cards

Technical information

This release is deployed on test at Jun 28, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.3.1.1 - release number update

Update release number to 0.3.1

Deployed on Test at Jun 26, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.3.1 - Credit Transfers (Buy and Sell)

This release includes both v0.3.0 and v0.3.1 features:

v0.3.0:

  • Credit Trader Role can Save a Draft
  • Credit Trader Role can Edit/Delete a Draft
  • Branch Analyst Role can Recommend a Transfer
  • Branch Director Role can Approve a Transfer
  • Signing Authority Role can Sign a Proposed/Accepted Transfer

v0.3.1

  • Initiator or Respondent CT can Rescind
  • Gov Roles can Decline a Transfer
  • Credit Trader Role can Reject/Refuse a Transfer

Data Migration and Fixtures

The following migrations are included:

  • 0011_auto_20180613_1848
  • 0012_credittradecomment
  • 0013_auto_20180619_2053
  • 0014_credittradecomment

The fixtures loaded include:

  • credit_trade_statuses_refused.json
  • permissions.json
  • roles.json
  • roles_permissions.json
  • roles_permissions_v0.3.0.json
  • signing_authority_assertions.json
  • users_roles.json

Implemented Trello Cards

Trello-323 Credit Transfer | Respondent can Refuse a Credit Transfer Proposal
Trello-336 Authorization | Approve Recommended Credit Transfer Proposals
Trello-338 Credit Transfer | Government Analyst Recommend Approval
Trello-345 UX Refactor | Hide unfinished tabs for IDIR users
Trello-350 Credit Transfer | Add 'Refused' status
Trello-383 Confirmation Alerts | Refuse a Credit Transfer Proposal
Trello-384 Confirmation Alerts | Rescind a Credit Transfer Proposal
Trello-385 Confirmation Alerts | Recommend Approval of a Credit Transfer Proposal
Trello-451 Authorization | Decline to Approve Recommended Credit Transfer Proposals
Trello-594 Credit Transfer | Add 'Rescinded' Status
Trello-624 UX Refactor Fuel Suppliers | By default sort List alphabetically by fuel supplier name
Trello-625 UX Refactor | redit Transactions | Hide elements for IDIR users
Trello-626 Fuel Suppliers | Add link to fuel suppliers list under Fuel Suppliers tab for BCeID users
Trello-635 Roles | Create Credit Trading role
Trello-636 Roles | Create Signing Authority role
Trello-650 UX Refactor Credit Balance | Display the total credits in the market
Trello-652 Authorization | Change Status
Trello-659 Breadcrumbs | Change Recommended breadcrumb to Reviewed
Trello-672 Credit Transfer | Add "Credit Market" tab that links to Credit Market Report
Trello-680 Credit Transfer | Create Information text boxes for non-clickable Sign 1/2 and Sign 2/2 buttons
Trello-681 Breadcrumbs | Reverse breadcrumb color scheme
Trello-683 Navigation | Move Log Out to the user's name heading
Trello-686 Authorization | List of fuel suppliers PDF is available to all fuel supplier users

Technical information

The release is deployed on Test at Jun 26, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - Backup - Tagging master before merging v0.3.0 changes in develop

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.2.0.4

This minor release includes:

  • Revert the effective dates that were overwritten by the approval process
  • Frontend text changes for consistency

Data Migration and Fixture

The following migrations are included:

N/A

The fixture loaded is

N/A

Implemented Trello Cards

Trello 653 - Defect | Update Effective Dates
Trello 649 - UX Refactor | Text Changes
Trello 648 - Responsive Design | fix column width class
Trello 622 - UX Refactor | Update Breadcrumb appearance

Technical information

The release is deployed on Test at Jun 08, 2018, on Prod at Jun 13, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - V0.2.0.3

This minor release includes:

  • Added two more confirmation before prod deployment
  • Revised changes to animation of icons
  • Fixed pluralization for credits when it's over 999
  • Added a StatusInterceptor on a more generic level
  • Filter credit transaction table by fuel supplier
  • Added 2 test fuel suppliers and 2 test users

Data Migration and Fixture

The following migrations are included:

N/A

The fixture loaded is

  • test_organization_for_basic_bceid.json
  • test_users_basic_bceid.json

Implemented Trello Cards

Technical information

  • This minor release is deployed on Test at May 31, 2018. Deployed on Prod Jun 5, 2018.
  • Refreshing SchemaSpy function has been added to pipeline in order to keep database mode document up-to-date.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - Add migration and fix frontend defect for previous release.

Implemented Trello Cards

N/A

Data Migrations

  • 0010_auto_20180529_2003.py

The fixtures loaded

N/A

Technical information

  • This release fixes a missed migration and a frontend defect for previous release.
  • This minor release is deployed on Test at May 29, 2018.
  • The pull request merges from release-v0.2.0 branch to master is:
    PR 319 Release v0.2.0.2

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.2.0.1

Implemented Trello Cards are:

Data Migration and Fixture

N/A

The fixture loaded is

N/A

Technical information

  • This minor release is deployed on Test at May 29, 2018. No prod deployment was executed.
  • The pull request merges from release-v0.2.0 branch to master is:
    PR 315 Release v0.2.0.1
  • There is a missed migration identified during the deployment. Also a defect found for frontend. Release v0.2.0.2 was immediately created to fix these errors.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - v0.2.0

User Features

Features Scheduled
A company can view the list of their transactions June 2018
A company can view the transaction details June 2018
A company can view their low carbon fuel credit balance June 2018

Data Migrations

  • 0008_auto_20180507_1734.py
  • 0009_signingauthorityassertion_signingauthorityconfirmation.py

Technical Changes

  • Openshift resource optimization

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - Deleted transfers

This minor release fixes deleted transfer:

  • Cancelled Transfers should be considered "deleted" ie should no longer show up in the tables.

Data Migration and Fixture

N/A

Implemented Trello Cards

Technical information

  • This minor release is deployed on test at May 8, 2018 and on prod at May 10, 2018

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - Backup - Tagging Develop before merging with v0.1.0.4

This tag is a backup for develop branch and created before merging release-v0.1.0.4 to develop.

Consumption - Mobility and Transportation - Python
Published by amichard almost 7 years ago

Transportation Fuels Reporting System - Adds a new fixture for Vancouver Island Propane Services

This release includes:

Trello #590 New Fuel Supplier

Fixture:

organization_vancouver_island_propane_services.json loaded on all three environment
test_tfrs_users_MichaelRensing.json loaded on test and prod

Technical Information:

This release is deployed on Test and Prod both at May 1, 2018
This release is merged back to develop at 2018-05-03, PR#267

Consumption - Mobility and Transportation - Python
Published by kuanfandevops almost 7 years ago

Transportation Fuels Reporting System - Hides the government row from the list of Fuel Suppliers

This release includes:

Trello 575 UX Refactor | Hide / Adjust Parts of the Fuel Suppliers Page to IDIR Users

Technical Information:

This release is deployed on Test at Apr 26, 2018 and deployed on prod at May 1, 2018.

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 7 years ago

Transportation Fuels Reporting System - Compliance period

This minor release adds the compliance period dropdown to the Historical Data Entry:

  • Added Compliance Period column in Historical Data Entry Table
  • Added Compliance Period column dropdown in Historical Data Entry Form
  • Credit From, Credit To and Transfer Type are all disabled in Historical Data Entry Form Edit*
  • Added backend code to support the Compliance Period

Data Migration and Fixture

The following migrations are included:

  • 0005_auto_20180424_1445.py
  • 0006_auto_20180424_1527.py
  • 0007_credittradehistory_compliance_period.py

The fixture loaded is

  • compliance_periods.json

Implemented Trello Cards

Technical information

  • This minor release is deployed on Test at Apr 26, 2018.
  • The pull request merges from release-v0.1.0 branch to master is:
    PR 240 Release v0.1.0.2

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 7 years ago

Transportation Fuels Reporting System - Updated the Fuel Suppliers Tab

This minor release updates the Fuel Suppliers page:

  • Use the same table style as Credit Transactions and Historical Data Entry
  • Unused buttons and filters are hidden
  • Credit Balance are displayed properly for each organization
  • Other columns are also populated

Implemented Trello Cards

Technical information

This minor release is deployed on Test at Apr 25, 2018.
The pull request merges from release-v0.1.0 branch to master is:

Consumption - Mobility and Transportation - Python
Published by kuanfandevops about 7 years ago